-- Logs begin at Fri 2022-10-14 12:21:45 UTC, end at Fri 2022-10-14 13:21:05 UTC. -- Oct 14 12:46:02.195448 dv-cinder-820994-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 14 12:46:02.204831 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 12:46:02 2022] *** Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: nodename: dv-cinder-820994-7-iscsi Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: machine: x86_64 Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: clock source: unix Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: pcre jit disabled Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: detected number of CPU cores: 4 Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: current working directory: / Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: detected binary path: /usr/bin/uwsgi-core Oct 14 12:46:02.206754 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: your processes number limit is 47680 Oct 14 12:46:02.207344 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: your memory page size is 4096 bytes Oct 14 12:46:02.207344 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: detected max file descriptor number: 2048 Oct 14 12:46:02.207344 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: lock engine: pthread robust mutexes Oct 14 12:46:02.207344 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: thunder lock: enabled Oct 14 12:46:02.207344 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 14 12:46:02.207344 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 12:46:02.246725 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: Python main interpreter initialized at 0x5604a7c6c9c0 Oct 14 12:46:02.246725 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: python threads support enabled Oct 14 12:46:02.246725 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: your server socket listen backlog is limited to 100 connections Oct 14 12:46:02.246725 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: your mercy for graceful operations on workers is 90 seconds Oct 14 12:46:02.247072 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 12:46:02.247072 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: *** Operational MODE: preforking *** Oct 14 12:46:02.247349 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: *** uWSGI is running in multiple interpreter mode *** Oct 14 12:46:02.247349 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: spawned uWSGI master process (pid: 81380) Oct 14 12:46:02.247550 dv-cinder-820994-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 14 12:46:02.249260 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: spawned uWSGI worker 1 (pid: 81394, cores: 1) Oct 14 12:46:02.249260 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: spawned uWSGI worker 2 (pid: 81395, cores: 1) Oct 14 12:46:02.249260 dv-cinder-820994-7-iscsi devstack@keystone.service[81380]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 12:46:06.534706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:46:06.534706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: from cryptography.utils import int_from_bytes Oct 14 12:46:06.535506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:46:06.535506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: from cryptography.utils import int_from_bytes Oct 14 12:46:06.535921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:46:06.535921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: from cryptography.utils import int_from_bytes Oct 14 12:46:06.536030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:46:06.536030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: from cryptography.utils import int_from_bytes Oct 14 12:46:06.585105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 12:46:06.585296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 12:46:06.585475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 12:46:06.585589 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] command line args: [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 12:46:06.585695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 12:46:06.585776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 12:46:06.585892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] command line args: [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 12:46:06.585972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ================================================================================ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 12:46:06.586165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 12:46:06.586251 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] admin_token = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.586329 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ================================================================================ {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 12:46:06.586406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] config_dir = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.586582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.586664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] admin_token = **** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.586767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] config_source = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.586852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] config_dir = [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.586950 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] debug = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587150 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] config_source = [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] debug = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.587953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588205 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] log_config_append = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] list_limit = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.588955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] log_config_append = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] log_dir = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] log_file = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] log_dir = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] log_file = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.589882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.590935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591218 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.591957 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.592075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.592202 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.592326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.592478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.592601 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.592845 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.592969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.593156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] publish_errors = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.593338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.593436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.593540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] publish_errors = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.593621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.593776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.593858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] standard_threads = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] standard_threads = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.594999 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] use_journal = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] use_json = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] use_stderr = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] use_journal = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] use_syslog = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] use_json = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.595966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.596048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] use_stderr = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.596199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.596284 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] use_syslog = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.596432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:06.596509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.596686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.596771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.596923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.597988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.598155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.598245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.598391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.598469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.598634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.598715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.598866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.598953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.599111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.599190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.599347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.599424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.599590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.599683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.599827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.599904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.600060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.600137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.600311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.600396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.600550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.600627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.600792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.600869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.601015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.601090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.601263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.601341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.601531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.601612 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.601787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.601871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602034 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.602959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.603038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.603194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.603271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.603434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604430 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604510 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.604988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.605149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.605227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.605395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.605493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.605649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.605728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.605884 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.605969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.606118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.606197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.606346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.606425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.606575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.606654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.606804 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.606882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.607955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.608970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.609119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.609234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.609342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.609441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.609598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.609706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.609838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.609943 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.610099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.610186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.610560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.610677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.610759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.610839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.611948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.612957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.613126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.613215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.613379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.613529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.613619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.613697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.613861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.613964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.614099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.614197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.614336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.614415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.614571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.614685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.614806 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.614902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615039 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615276 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.615989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.616078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.616220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.616299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.616452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.616533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.616684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.616774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.616918 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.617971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.618132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.618226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.618368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.618449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.618607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.618687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.618843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.618999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.619083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.619194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.619881 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.619965 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.620116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.620208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.620348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.620430 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.620577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.620659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.620812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.620908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.621048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.621131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.621287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.621378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.621545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.621692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.621787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.621944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.622025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.622183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.622269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.622439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.622529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.622698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.622780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.622937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.623024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.623169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.external = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.623264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.623400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.623490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] auth.external = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.623658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.623738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.623917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.password = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624237 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] auth.token = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] auth.password = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] auth.token = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.624939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.625085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.625166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.625313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.625393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.625581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.625678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.625829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.625912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.626060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.626149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.626293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.626384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.626532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] credential.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.626612 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.626777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.626857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627113 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627264 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.627971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.628051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.628221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.628302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.628477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.628567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.628721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.628803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.628979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.629085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.629266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.629359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.629537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.629661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.629811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.629905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.630059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.630150 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.630320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.630402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.630559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] federation.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.630641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.630798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.630889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.631050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.631132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.631278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.631359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.631523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.631605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.631755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.631834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.632962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.633045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.633194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.633276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.633437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.633539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.633712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.633792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.633940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.634978 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.635145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.635228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.635394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.635476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.635682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.635773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.635858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.635935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.636072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.636155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.636313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.636395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.636560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.636642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.636802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.636882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.637053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.637143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.637294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.637381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.637572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.637656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.637809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.637889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.638973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.639055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.639213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.639293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.639451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.639531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.639697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.639777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.639925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.640967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.641129 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.641209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.641359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.641449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.641616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.641700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.641846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.641928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.642080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.642172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.642313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.642400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.642550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.642631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.642784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.642873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.643023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.643130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.643374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.643455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.643618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.643706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.643851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.643933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.644080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.644161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.644314 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.644401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.644563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.644644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.644798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.644879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.645997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.646079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.646226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.646306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.646471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.646562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.646716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.646798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.646962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.647985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.648124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.648213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.648352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.648434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.648583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.648671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.648828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.648908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.649073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.649155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.649316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.649406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.649582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.649665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.649817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.649898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.650060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.650151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.650295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.650376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.650590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.650671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.650825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.651985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.652068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.652217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.652308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.652460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.652541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.652690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.652770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.652922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653476 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.653969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.654122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.654204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.654362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.654451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.654608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] resource.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.654690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.654852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.654932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.655088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.655178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.655330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.655411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.655577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.655658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.655810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.655900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.656052 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.656133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.656301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.656383 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.656528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.656606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.656772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.656854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] role.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.657011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] role.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.657093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] role.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.657238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.657320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] role.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.657500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.657583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.657756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.657837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658329 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.658988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.659069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.659235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.659317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.659486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.659568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.659730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.659896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.659976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.660163 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.660254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.660415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.660497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.660666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.660748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.661064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.661154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.661304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.661384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.661581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.661666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.661838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.661932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.662092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.662174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.662346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.662428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.662579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.662661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.662835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.662916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.663083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.663164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.663323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.663407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.663556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.663638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.663787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.664979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.665060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.665213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.665295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.665444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.665551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.665706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] token.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.665788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] token.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.665940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.666507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.666699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.666784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.666936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.667995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.668155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.668239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.668398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.668480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.668633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.668715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.668869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.668952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.669102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.669183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.669344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.669426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.669638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.669724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.669873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.669965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.670116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.670205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.670376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.670459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.670631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.670721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.connection = **** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.670871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.670954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.671115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.671198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.671352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.671443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.671590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.671672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.671823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.671905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.672057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.672147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.672291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.672373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.672525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.672612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.672768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.672858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.673004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.673095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.673245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.673331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.673528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.673632 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.673751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.673833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.674462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.674542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.674616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.674701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.674778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.674852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.674926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.675000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.675074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.675156 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:06.675233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 12:46:06.675307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 12:46:06.704777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.704948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.705054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.705185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.705271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.705416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.713654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.713966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.742281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.742508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.743372 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.743609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.796868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.797003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.845813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.846040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.846133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:06.846281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.002145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.002373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.002597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.002752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.002868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.002994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.003121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.003207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.003298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.003432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.003657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.003874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.026407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.026636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.026863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.026963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027170 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.027950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.028165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.038856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.039296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.051468 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.051651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.051873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.051969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.052096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.052209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.052317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.052441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.052534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.052671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.052754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.052897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.053117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.053335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:07.069716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.069928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 12:46:07.070266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.070433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.070518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 12:46:07.070650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 12:46:07.070735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.070973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.071055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.071187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 12:46:07.071277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.071470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.071553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.071739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.072005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.072853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.081574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.081859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.082132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.082414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.082506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.082749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.083025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.083312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.089451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.090350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.092688 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.092979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.093239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.093323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.093553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.093638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.093844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.093928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.094139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.094227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.094409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.094499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.094682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.094766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.094952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.095031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.095226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.095307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.095496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.095578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.095774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.096047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.118114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.118852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.120140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.120427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.120873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.121166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.125040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.125325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.125632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.125850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.126142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.126430 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.131869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.132158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.132738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.133032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.138284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.138580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.138871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.139160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.139241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.139441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.139523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.139720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.139801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.139991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.140103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.140262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.140386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.140664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.140940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.141216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.155630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.155910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.156696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.156983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.159746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.160835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.162961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.163259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.164099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.164402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.167491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.168693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.170632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.171933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.173856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.174158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.174447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.174735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.175027 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.175183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.175316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.175489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.175779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.176066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.176366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.176661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.191439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.191729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.192001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.192267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.192917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.193212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.193498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.193777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.199107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.200627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.200752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.202171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.202256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.202449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.203787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.204069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.205069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.205352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.205657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.205945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.206346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.206804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.207096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.207383 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.207673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.208073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.217905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.218190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.218473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.218756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.219136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.219437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.219719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.219801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.220034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.220321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.220608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.220996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.221304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.221616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.235913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.238067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.238808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.240983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.241679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.243109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.243905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.244667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.244938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.245372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.245635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.247219 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.247510 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.247922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.251663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.253109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.254301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.255773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.256008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.256405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.256694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.256971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.258692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.259091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.259386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.259704 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.265192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.265607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.265898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.267530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.267829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.268115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.272757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.273043 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.273324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.273625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.273899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.274170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.274440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.274725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.274993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:07.275075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.275269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.275840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.276087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.276179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.276388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.276472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.276651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.276734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.276921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.277004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.277196 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.277516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.277793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.278070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.278363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.278640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.278909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.279197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:07.312855 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5604a7c6c9c0 pid: 81395 (default app) Oct 14 12:46:07.313764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5604a7c6c9c0 pid: 81394 (default app) Oct 14 12:46:07.316611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6252fe-4f24-471b-ab09-20506e7db320 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:07.316989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6252fe-4f24-471b-ab09-20506e7db320 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:07.317170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6252fe-4f24-471b-ab09-20506e7db320 None None] PATH_INFO: `/v3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:07.322115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Fri Oct 14 12:46:07 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:14.035733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51adf7-a43a-43fc-813e-605520b589a3 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:14.036190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51adf7-a43a-43fc-813e-605520b589a3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:14.036352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51adf7-a43a-43fc-813e-605520b589a3 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:14.040612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:14.045797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:14.046226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:14.046364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:14.116905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: INFO dbcounter [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] Registered counter for database keystone Oct 14 12:46:14.136047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG oslo_db.sqlalchemy.engines [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:46:14.142219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writer thread running {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:46:14.319989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG passlib.handlers.bcrypt [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81395) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 14 12:46:14.320306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG passlib.handlers.bcrypt [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81395) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 14 12:46:14.377865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:14.379467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:14.504695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:46:14.952283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51adf7-a43a-43fc-813e-605520b589a3 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:15.021432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: INFO dbcounter [None req-6f51adf7-a43a-43fc-813e-605520b589a3 None None] Registered counter for database keystone Oct 14 12:46:15.043130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG oslo_db.sqlalchemy.engines [None req-6f51adf7-a43a-43fc-813e-605520b589a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:46:15.049309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writer thread running {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:46:15.165041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51adf7-a43a-43fc-813e-605520b589a3 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:15.169333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67894e3a-bd4a-4258-be7b-49af8fb7e2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:15.169973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67894e3a-bd4a-4258-be7b-49af8fb7e2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:15.170249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67894e3a-bd4a-4258-be7b-49af8fb7e2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:15.170515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67894e3a-bd4a-4258-be7b-49af8fb7e2c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:15.178546 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67894e3a-bd4a-4258-be7b-49af8fb7e2c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:15.229846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING keystone.common.rbac_enforcer.enforcer [None req-67894e3a-bd4a-4258-be7b-49af8fb7e2c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 14 12:46:15.230129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67894e3a-bd4a-4258-be7b-49af8fb7e2c0 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:15.239658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Fri Oct 14 12:46:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 12:46:15.246187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:15.263908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6652405-ed12-412b-b1b8-e6c9a3a22e2a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:15.268283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2e7d4-84a5-4319-beef-fe900cf240ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:15.269376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2e7d4-84a5-4319-beef-fe900cf240ce admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:15.269693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2e7d4-84a5-4319-beef-fe900cf240ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:15.269967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2e7d4-84a5-4319-beef-fe900cf240ce admin admin] PATH_INFO: `/v3/projects/48f83413dd8d497d98e9b13f0fa4b793` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:15.271556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2e7d4-84a5-4319-beef-fe900cf240ce admin admin] RBAC: Authorizing `identity:get_project(project_id=48f83413dd8d497d98e9b13f0fa4b793)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:15.323653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b7d2e7d4-84a5-4319-beef-fe900cf240ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 14 12:46:15.324005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2e7d4-84a5-4319-beef-fe900cf240ce admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:15.328505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Fri Oct 14 12:46:15 2022] GET /identity/v3/projects/48f83413dd8d497d98e9b13f0fa4b793 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:17.433067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9a63-0020-4df3-a49a-93d19c340f1e None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:17.433599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9a63-0020-4df3-a49a-93d19c340f1e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:17.433685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9a63-0020-4df3-a49a-93d19c340f1e None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:17.437887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:17.443406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69bc4-bf5f-49c0-b8f5-d51146f8b45e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:17.443763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69bc4-bf5f-49c0-b8f5-d51146f8b45e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:17.443943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69bc4-bf5f-49c0-b8f5-d51146f8b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:17.463910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0ae69bc4-bf5f-49c0-b8f5-d51146f8b45e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:17.465411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0ae69bc4-bf5f-49c0-b8f5-d51146f8b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:17.473431 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 14 12:46:17.743970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9a63-0020-4df3-a49a-93d19c340f1e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:17.756003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9a63-0020-4df3-a49a-93d19c340f1e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:17.760747 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4a040-1f96-4c56-9b42-b927f5f33039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:17.761339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a040-1f96-4c56-9b42-b927f5f33039 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:17.761642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a040-1f96-4c56-9b42-b927f5f33039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:17.761914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4a040-1f96-4c56-9b42-b927f5f33039 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:17.769359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4a040-1f96-4c56-9b42-b927f5f33039 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:17.771133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4a040-1f96-4c56-9b42-b927f5f33039 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:17.779882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Fri Oct 14 12:46:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 12:46:17.785026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69bc4-bf5f-49c0-b8f5-d51146f8b45e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:17.794033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69bc4-bf5f-49c0-b8f5-d51146f8b45e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:17.798298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d0998-b707-46e9-803a-366f5e632d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:17.798913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d0998-b707-46e9-803a-366f5e632d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:17.799187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d0998-b707-46e9-803a-366f5e632d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:17.799455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d0998-b707-46e9-803a-366f5e632d37 admin admin] PATH_INFO: `/v3/users/ced917b9e08744f88e2078e19eb8640b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:17.800781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d0998-b707-46e9-803a-366f5e632d37 admin admin] RBAC: Authorizing `identity:get_user(user_id=ced917b9e08744f88e2078e19eb8640b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:17.802639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d0998-b707-46e9-803a-366f5e632d37 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:17.804133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Fri Oct 14 12:46:17 2022] GET /identity/v3/users/ced917b9e08744f88e2078e19eb8640b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:19.974120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30e956-3f92-44b3-a7e6-0eeafced448d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:19.974651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30e956-3f92-44b3-a7e6-0eeafced448d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:19.974651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30e956-3f92-44b3-a7e6-0eeafced448d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:19.976250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:19.981732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcd4d8-1884-4bfe-a6e0-06acdb258cd9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:19.982158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcd4d8-1884-4bfe-a6e0-06acdb258cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:19.982284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcd4d8-1884-4bfe-a6e0-06acdb258cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.000764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-60fcd4d8-1884-4bfe-a6e0-06acdb258cd9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:20.002027 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-60fcd4d8-1884-4bfe-a6e0-06acdb258cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:20.029123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3834c0-afe2-4dc3-bc1d-edbf91389dcd None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.029403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3834c0-afe2-4dc3-bc1d-edbf91389dcd None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.029703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3834c0-afe2-4dc3-bc1d-edbf91389dcd None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.031011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:20.035964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.036241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.036510 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.078291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG passlib.handlers.bcrypt [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81394) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 14 12:46:20.078688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG passlib.handlers.bcrypt [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81394) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 14 12:46:20.083405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:20.128091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:20.129700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:20.225371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:20.348861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcd4d8-1884-4bfe-a6e0-06acdb258cd9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:20.373757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:20.452378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcd4d8-1884-4bfe-a6e0-06acdb258cd9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:20.485870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c1e96-dab6-41e8-95f0-72e6820d71ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:20.486441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c1e96-dab6-41e8-95f0-72e6820d71ee None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.486717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c1e96-dab6-41e8-95f0-72e6820d71ee None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.486990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c1e96-dab6-41e8-95f0-72e6820d71ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.488479 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:20.498893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c1e96-dab6-41e8-95f0-72e6820d71ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a53c1e96-dab6-41e8-95f0-72e6820d71ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:20.507816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:20.508862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:46:20.510354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:46:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:20.515016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c1e96-dab6-41e8-95f0-72e6820d71ee None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:20.589884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a740-ac4f-4c69-a246-da82572e2045 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:20.592139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:20.595136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:20.613955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c1e96-dab6-41e8-95f0-72e6820d71ee None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:20.627133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:20.627987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.628269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.628542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.629527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:20.630962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:20.642410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.sql.core [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:46:20.642410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:46:20.642410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [parameters: {'id': '71a625c8dd8c4090b3a6eeddc9209354', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 12:46:20.642410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81394) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:46:20.647181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:20.647781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.648054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.648328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.648983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:20.649282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:20.650768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:46:20.660870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application result.read() Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 12:46:20.661741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application yield resource Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise self.value Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application session.commit() Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:46:20.662675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:46:20.663555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:46:20.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application result.read() Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:46:20.665321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [parameters: {'id': '71a625c8dd8c4090b3a6eeddc9209354', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 12:46:20.666186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:20.666926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:20.669375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 8/15] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Oct 14 12:46:20 2022] POST /identity/v3/domains => generated 190 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:20.670286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 8/16] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:20.670373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:20.670460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:20.767192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65296d-a50e-468d-8552-dbf526e4dcc1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:20.768448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8a00-d92d-4d8c-9e01-f054e71be046 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:20.799232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fb59b-1e46-45e0-87a0-e49dcaef58b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:20.799941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb59b-1e46-45e0-87a0-e49dcaef58b3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.800221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb59b-1e46-45e0-87a0-e49dcaef58b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.800518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb59b-1e46-45e0-87a0-e49dcaef58b3 None admin] PATH_INFO: `/v3/users/ced917b9e08744f88e2078e19eb8640b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.801229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:20.801669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fb59b-1e46-45e0-87a0-e49dcaef58b3 None admin] RBAC: Authorizing `identity:get_user(user_id=ced917b9e08744f88e2078e19eb8640b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:20.802099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.802377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.802646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.803162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fb59b-1e46-45e0-87a0-e49dcaef58b3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:20.804705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:20 2022] GET /identity/v3/users/ced917b9e08744f88e2078e19eb8640b => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:20.810623 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fb59b-1e46-45e0-87a0-e49dcaef58b3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:20.821536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:20.823513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:20.825446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:46:20.839651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:20.840608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:46:20.841427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:46:20.841427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:46:20.841427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:20.841427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:20.846688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:20.869185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:20.910083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fb59b-1e46-45e0-87a0-e49dcaef58b3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:20.942291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5ae8-49b4-4100-af3c-511375d4283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:20.942920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5ae8-49b4-4100-af3c-511375d4283f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.943197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5ae8-49b4-4100-af3c-511375d4283f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.943465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5ae8-49b4-4100-af3c-511375d4283f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.944573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed5ae8-49b4-4100-af3c-511375d4283f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:20.946046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed5ae8-49b4-4100-af3c-511375d4283f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:20.948108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:20.948744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d368f2-bbfd-496e-9530-ae4ea713f068 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:20.953840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5ae8-49b4-4100-af3c-511375d4283f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:20.983919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f02b95-8020-4f5d-a990-2f4ddeccf760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:20.984536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f02b95-8020-4f5d-a990-2f4ddeccf760 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:20.984814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f02b95-8020-4f5d-a990-2f4ddeccf760 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:20.985339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f02b95-8020-4f5d-a990-2f4ddeccf760 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:20.986031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f02b95-8020-4f5d-a990-2f4ddeccf760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:20.986335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f02b95-8020-4f5d-a990-2f4ddeccf760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:20.987722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f02b95-8020-4f5d-a990-2f4ddeccf760 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:21.005945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:21.036323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:21.056675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5ae8-49b4-4100-af3c-511375d4283f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:21.092882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939764a3-f4c9-41da-8737-a4fc585a7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:21.093585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939764a3-f4c9-41da-8737-a4fc585a7534 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:21.093864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939764a3-f4c9-41da-8737-a4fc585a7534 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:21.094134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939764a3-f4c9-41da-8737-a4fc585a7534 None admin] PATH_INFO: `/v3/domains/default/users/ced917b9e08744f88e2078e19eb8640b/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:21.096146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939764a3-f4c9-41da-8737-a4fc585a7534 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ced917b9e08744f88e2078e19eb8640b, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:21.097652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939764a3-f4c9-41da-8737-a4fc585a7534 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:21.214217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 11/21] 10.222.0.47 () {58 vars in 1361 bytes} [Fri Oct 14 12:46:20 2022] PUT /identity/v3/domains/default/users/ced917b9e08744f88e2078e19eb8640b/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:46:23.480562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96927396-3e88-427a-bd6c-1a5282975f45 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:23.481070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96927396-3e88-427a-bd6c-1a5282975f45 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:23.481070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96927396-3e88-427a-bd6c-1a5282975f45 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:23.482612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:23.503936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894b21-3454-48bc-a6f5-5306077603b2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:23.504413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894b21-3454-48bc-a6f5-5306077603b2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:23.504486 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c894b21-3454-48bc-a6f5-5306077603b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:23.534734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9c894b21-3454-48bc-a6f5-5306077603b2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:23.536310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9c894b21-3454-48bc-a6f5-5306077603b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:23.624672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 12/23] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:23.724218 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc412-8b3c-4787-a1d3-ac919e473234 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:23.724533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc412-8b3c-4787-a1d3-ac919e473234 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:23.724757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc412-8b3c-4787-a1d3-ac919e473234 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:23.726119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 12/24] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:23.739083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c570-66c7-4632-9912-ecb08321128d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:23.739382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c570-66c7-4632-9912-ecb08321128d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:23.739560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c570-66c7-4632-9912-ecb08321128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:23.761704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5b92c570-66c7-4632-9912-ecb08321128d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:23.763278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5b92c570-66c7-4632-9912-ecb08321128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:23.857010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:23.865354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e102997-8d6e-4e06-941e-f8767fce8891 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:23.865672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e102997-8d6e-4e06-941e-f8767fce8891 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:23.865947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e102997-8d6e-4e06-941e-f8767fce8891 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:23.866691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:23.867514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 13/26] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:23.891035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf52ad-0a26-401b-a53e-7f96e8c0d693 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:23.891525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf52ad-0a26-401b-a53e-7f96e8c0d693 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:23.891945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf52ad-0a26-401b-a53e-7f96e8c0d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:23.913797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7ecf52ad-0a26-401b-a53e-7f96e8c0d693 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:23.915341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7ecf52ad-0a26-401b-a53e-7f96e8c0d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:23.915480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e102997-8d6e-4e06-941e-f8767fce8891 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:24.007948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:24.031409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e102997-8d6e-4e06-941e-f8767fce8891 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:24.051766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 14/27] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:24.067459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:24.068301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:24.068715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:24.069121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:24.080178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:24.081848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:46:24.096899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:24.097953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:46:24.098994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:46:24.098994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:46:24.098994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:24.100324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 14/28] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:46:24.106765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf52ad-0a26-401b-a53e-7f96e8c0d693 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:24.207215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:24.265001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf52ad-0a26-401b-a53e-7f96e8c0d693 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:24.301870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:24.306111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:24.306925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:24.307346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:24.307756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:24.308545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:24.309132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:24.311043 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:24.335977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 15/29] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:24.342740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:24.398948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717667f-7b61-4ae2-b1f2-6360d4b750de None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:24.435544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:24.442506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a590548-f363-440e-9399-d5612386ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:24.443528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a590548-f363-440e-9399-d5612386ef11 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:24.444046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a590548-f363-440e-9399-d5612386ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:24.444512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a590548-f363-440e-9399-d5612386ef11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:24.457295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a590548-f363-440e-9399-d5612386ef11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2a590548-f363-440e-9399-d5612386ef11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:24.465026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:24.465898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:24.466667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:24.469355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 15/30] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:46:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:46:24.470529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a590548-f363-440e-9399-d5612386ef11 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:24.473862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeed894-69f9-4bcf-99bd-5190e9f46dd2 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:24.517683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3824-a494-40bf-bb1b-ee9c52159ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:24.519442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3824-a494-40bf-bb1b-ee9c52159ad1 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:24.519926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3824-a494-40bf-bb1b-ee9c52159ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:24.520391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa3824-a494-40bf-bb1b-ee9c52159ad1 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:24.521250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa3824-a494-40bf-bb1b-ee9c52159ad1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:24.523068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa3824-a494-40bf-bb1b-ee9c52159ad1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:24.560509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 16/31] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:46:24 2022] POST /identity/v3/projects => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:46:24.561815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3824-a494-40bf-bb1b-ee9c52159ad1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:24.626087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:24.685147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa3824-a494-40bf-bb1b-ee9c52159ad1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:24.720149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a590548-f363-440e-9399-d5612386ef11 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:24.724797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f89625-ef1e-4d97-bf8f-984b5168f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:24.725699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89625-ef1e-4d97-bf8f-984b5168f714 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:24.726176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89625-ef1e-4d97-bf8f-984b5168f714 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:24.726648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f89625-ef1e-4d97-bf8f-984b5168f714 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:24.728131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89625-ef1e-4d97-bf8f-984b5168f714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:24.728697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89625-ef1e-4d97-bf8f-984b5168f714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:24.730355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f89625-ef1e-4d97-bf8f-984b5168f714 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:24.740791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 17/32] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:24.742620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394803d-efcc-42b8-88b6-7b2411a2a074 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:24.744296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394803d-efcc-42b8-88b6-7b2411a2a074 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:24.744896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394803d-efcc-42b8-88b6-7b2411a2a074 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:24.747030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 18/33] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:24.748027 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394803d-efcc-42b8-88b6-7b2411a2a074 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:24.808178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b94e49-1009-4be0-af4f-46ed53015aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:24.808739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94e49-1009-4be0-af4f-46ed53015aa1 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:24.809022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94e49-1009-4be0-af4f-46ed53015aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:24.809300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94e49-1009-4be0-af4f-46ed53015aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:24.810038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b94e49-1009-4be0-af4f-46ed53015aa1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:24.811518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b94e49-1009-4be0-af4f-46ed53015aa1 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:24.960439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 16/34] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Oct 14 12:46:24 2022] POST /identity/v3/roles => generated 219 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:24.962537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad1a0d-c05e-4e8f-b2e8-2f73f96c4af7 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:24.962833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad1a0d-c05e-4e8f-b2e8-2f73f96c4af7 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:24.963114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad1a0d-c05e-4e8f-b2e8-2f73f96c4af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:24.987609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-24ad1a0d-c05e-4e8f-b2e8-2f73f96c4af7 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:24.989197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-24ad1a0d-c05e-4e8f-b2e8-2f73f96c4af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:24.990642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394803d-efcc-42b8-88b6-7b2411a2a074 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:25.005473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:25.085554 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa49b1-ff78-4057-a8dc-328d4aee55fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:25.086188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa49b1-ff78-4057-a8dc-328d4aee55fd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:25.086464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa49b1-ff78-4057-a8dc-328d4aee55fd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:25.086734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa49b1-ff78-4057-a8dc-328d4aee55fd None admin] PATH_INFO: `/v3/users/ced917b9e08744f88e2078e19eb8640b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:25.091697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa49b1-ff78-4057-a8dc-328d4aee55fd None admin] RBAC: Authorizing `identity:get_user(user_id=ced917b9e08744f88e2078e19eb8640b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:25.093353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa49b1-ff78-4057-a8dc-328d4aee55fd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:25.095386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 19/35] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:24 2022] GET /identity/v3/users/ced917b9e08744f88e2078e19eb8640b => generated 247 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:25.101778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa49b1-ff78-4057-a8dc-328d4aee55fd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:25.110856 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:25.148881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 17/36] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:25.250596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa49b1-ff78-4057-a8dc-328d4aee55fd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:25.289527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e8f68-d79c-40e9-a01e-2fc07298d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:25.290351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8f68-d79c-40e9-a01e-2fc07298d411 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:25.290628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8f68-d79c-40e9-a01e-2fc07298d411 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:25.290901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8f68-d79c-40e9-a01e-2fc07298d411 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:25.292036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e8f68-d79c-40e9-a01e-2fc07298d411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:25.293605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e8f68-d79c-40e9-a01e-2fc07298d411 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:25.295698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 20/37] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:25.301371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad1a0d-c05e-4e8f-b2e8-2f73f96c4af7 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:25.421518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad1a0d-c05e-4e8f-b2e8-2f73f96c4af7 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:25.467166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4f4d9-4a56-4c27-96f5-8692b96cfb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:25.467826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4f4d9-4a56-4c27-96f5-8692b96cfb6e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:25.468107 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4f4d9-4a56-4c27-96f5-8692b96cfb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:25.468381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4f4d9-4a56-4c27-96f5-8692b96cfb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:25.469225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4f4d9-4a56-4c27-96f5-8692b96cfb6e None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.domain.id=default, user.id=ced917b9e08744f88e2078e19eb8640b) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:25.469562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4f4d9-4a56-4c27-96f5-8692b96cfb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:25.471230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe4f4d9-4a56-4c27-96f5-8692b96cfb6e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:25.484011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 18/38] 10.222.0.47 () {56 vars in 1322 bytes} [Fri Oct 14 12:46:25 2022] GET /identity/v3/role_assignments?user.id=ced917b9e08744f88e2078e19eb8640b&scope.domain.id=default&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 530 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:25.497313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e8f68-d79c-40e9-a01e-2fc07298d411 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:25.518184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691aa69-c339-4149-8e43-87fcfaee95ce None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:25.518184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691aa69-c339-4149-8e43-87fcfaee95ce None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:25.518184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691aa69-c339-4149-8e43-87fcfaee95ce None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:25.518957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 19/39] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:25.525958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cc89-7fa5-4be8-b438-7ea419b6d1cc None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:25.526478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cc89-7fa5-4be8-b438-7ea419b6d1cc None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:25.526926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cc89-7fa5-4be8-b438-7ea419b6d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:25.546451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-cc65cc89-7fa5-4be8-b438-7ea419b6d1cc None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:25.548389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cc65cc89-7fa5-4be8-b438-7ea419b6d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:25.574990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:25.599365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:25.628897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 20/40] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:25.629796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e8f68-d79c-40e9-a01e-2fc07298d411 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:25.631060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9575-1b9b-41e8-809f-3ba69947d331 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:25.631449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9575-1b9b-41e8-809f-3ba69947d331 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:25.631830 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9575-1b9b-41e8-809f-3ba69947d331 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:25.633526 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 21/41] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:25.639547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eee07-36d0-41e9-aaa5-d44e94bed31f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:25.639899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eee07-36d0-41e9-aaa5-d44e94bed31f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:25.640245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7eee07-36d0-41e9-aaa5-d44e94bed31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:25.660303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2d7eee07-36d0-41e9-aaa5-d44e94bed31f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:25.661650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2d7eee07-36d0-41e9-aaa5-d44e94bed31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:25.679629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070488d-5c6f-43b0-97d6-f2e7b0da535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:25.680179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070488d-5c6f-43b0-97d6-f2e7b0da535c None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:25.680832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070488d-5c6f-43b0-97d6-f2e7b0da535c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:25.681132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070488d-5c6f-43b0-97d6-f2e7b0da535c None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:25.681834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070488d-5c6f-43b0-97d6-f2e7b0da535c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:25.683219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070488d-5c6f-43b0-97d6-f2e7b0da535c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:25.701866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 21/42] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Oct 14 12:46:25 2022] POST /identity/v3/roles => generated 225 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:25.745574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 22/43] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:25.913363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070488d-5c6f-43b0-97d6-f2e7b0da535c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:26.013866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eee07-36d0-41e9-aaa5-d44e94bed31f None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:26.014362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:26.017177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070488d-5c6f-43b0-97d6-f2e7b0da535c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:26.051255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c213c-a1b0-4e33-83a4-b794f13e9704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:26.051889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c213c-a1b0-4e33-83a4-b794f13e9704 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:26.052162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c213c-a1b0-4e33-83a4-b794f13e9704 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:26.052433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c213c-a1b0-4e33-83a4-b794f13e9704 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:26.053559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c213c-a1b0-4e33-83a4-b794f13e9704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:26.055035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c213c-a1b0-4e33-83a4-b794f13e9704 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:26.057407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 22/44] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:26.062763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c213c-a1b0-4e33-83a4-b794f13e9704 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:26.111208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7eee07-36d0-41e9-aaa5-d44e94bed31f None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:26.118601 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:26.145135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba86368-75a6-4f13-98f9-821ddcbc1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:26.145773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86368-75a6-4f13-98f9-821ddcbc1349 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:26.146061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86368-75a6-4f13-98f9-821ddcbc1349 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:26.146341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86368-75a6-4f13-98f9-821ddcbc1349 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:26.147008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba86368-75a6-4f13-98f9-821ddcbc1349 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:26.148385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba86368-75a6-4f13-98f9-821ddcbc1349 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:26.158646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c213c-a1b0-4e33-83a4-b794f13e9704 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:26.162155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 23/45] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Oct 14 12:46:26 2022] POST /identity/v3/roles => generated 223 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:26.198153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fe948-d57c-489e-a48a-e6e61760a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:26.198784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe948-d57c-489e-a48a-e6e61760a9f6 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:26.199063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe948-d57c-489e-a48a-e6e61760a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:26.199335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fe948-d57c-489e-a48a-e6e61760a9f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:26.200005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fe948-d57c-489e-a48a-e6e61760a9f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:26.201547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fe948-d57c-489e-a48a-e6e61760a9f6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:26.230635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:46:26 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:46:28.390990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56e47-11df-4a30-8e6e-2cb6c4eb41ba None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:28.391484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56e47-11df-4a30-8e6e-2cb6c4eb41ba None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:28.391567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56e47-11df-4a30-8e6e-2cb6c4eb41ba None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:28.392882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 24/47] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:28.398164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00d30-8a96-4144-9bba-07acb0e4e58a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:28.398554 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00d30-8a96-4144-9bba-07acb0e4e58a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:28.398704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00d30-8a96-4144-9bba-07acb0e4e58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:28.416676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4ef00d30-8a96-4144-9bba-07acb0e4e58a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:28.417895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4ef00d30-8a96-4144-9bba-07acb0e4e58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:28.431947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:28.482592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 24/48] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:28.752917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe56e47-11df-4a30-8e6e-2cb6c4eb41ba None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:28.850187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe56e47-11df-4a30-8e6e-2cb6c4eb41ba None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:28.882837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf622c38-e077-4e17-b843-311f7549f3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:28.883477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622c38-e077-4e17-b843-311f7549f3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:28.883758 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622c38-e077-4e17-b843-311f7549f3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:28.884029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622c38-e077-4e17-b843-311f7549f3b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:28.885142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf622c38-e077-4e17-b843-311f7549f3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:28.886623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf622c38-e077-4e17-b843-311f7549f3b1 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:28.888159 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 25/49] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:28.893693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef00d30-8a96-4144-9bba-07acb0e4e58a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:28.991138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef00d30-8a96-4144-9bba-07acb0e4e58a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:29.023000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec62719-b18d-4363-9ddc-1296224763c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:29.023553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec62719-b18d-4363-9ddc-1296224763c1 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:29.023831 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec62719-b18d-4363-9ddc-1296224763c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:29.024672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec62719-b18d-4363-9ddc-1296224763c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:29.025311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec62719-b18d-4363-9ddc-1296224763c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:29.026794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec62719-b18d-4363-9ddc-1296224763c1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:29.052212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 25/50] 10.222.0.47 () {60 vars in 1140 bytes} [Fri Oct 14 12:46:28 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:31.166149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a423-89ee-4773-ba16-ab56c29020e5 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:31.166642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a423-89ee-4773-ba16-ab56c29020e5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:31.166725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548a423-89ee-4773-ba16-ab56c29020e5 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:31.168041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 26/51] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:31.173271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7831-63bd-424a-9148-9c772276195f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:31.173681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7831-63bd-424a-9148-9c772276195f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:31.173859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7831-63bd-424a-9148-9c772276195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:31.180109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:31.193228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0e7f7831-63bd-424a-9148-9c772276195f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:31.194454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0e7f7831-63bd-424a-9148-9c772276195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:31.259042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 26/52] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:31.526331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a423-89ee-4773-ba16-ab56c29020e5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:31.560693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:31.628246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548a423-89ee-4773-ba16-ab56c29020e5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:31.660898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bdba2-057e-4496-9006-9a73317552c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:31.661541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bdba2-057e-4496-9006-9a73317552c8 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:31.661820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bdba2-057e-4496-9006-9a73317552c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:31.662088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bdba2-057e-4496-9006-9a73317552c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:31.663178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bdba2-057e-4496-9006-9a73317552c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:31.664682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bdba2-057e-4496-9006-9a73317552c8 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:31.666259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 27/53] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:31.671728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f7831-63bd-424a-9148-9c772276195f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:31.766536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f7831-63bd-424a-9148-9c772276195f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:31.793961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:31.799052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be44a17-41cd-42a2-95cb-652b3cc80219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:31.799652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44a17-41cd-42a2-95cb-652b3cc80219 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:31.799927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44a17-41cd-42a2-95cb-652b3cc80219 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:31.800196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be44a17-41cd-42a2-95cb-652b3cc80219 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:31.800845 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44a17-41cd-42a2-95cb-652b3cc80219 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:31.802313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be44a17-41cd-42a2-95cb-652b3cc80219 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:31.828718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 27/54] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:46:31 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:34.847910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609d745-93a3-4b11-87cd-98724aaf26ee None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:34.848446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609d745-93a3-4b11-87cd-98724aaf26ee None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:34.848524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609d745-93a3-4b11-87cd-98724aaf26ee None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:34.850191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 28/55] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:34.855127 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201140b-caf0-4228-93de-6073f27473b5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:34.855932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201140b-caf0-4228-93de-6073f27473b5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:34.856485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201140b-caf0-4228-93de-6073f27473b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:34.880096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9201140b-caf0-4228-93de-6073f27473b5 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:34.881852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9201140b-caf0-4228-93de-6073f27473b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:34.969167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 28/56] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:35.190646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce17ca-673e-4151-8c1a-51269029a603 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.191306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce17ca-673e-4151-8c1a-51269029a603 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.191786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce17ca-673e-4151-8c1a-51269029a603 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.193631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 29/57] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:35.199020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54eb5-31ab-40e3-95ab-1725f250ac79 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.199519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54eb5-31ab-40e3-95ab-1725f250ac79 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.200011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54eb5-31ab-40e3-95ab-1725f250ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.221301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-07b54eb5-31ab-40e3-95ab-1725f250ac79 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:35.222776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-07b54eb5-31ab-40e3-95ab-1725f250ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:35.313707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 29/58] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:35.361556 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce17ca-673e-4151-8c1a-51269029a603 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:35.497579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3527d-84e1-47f1-9800-0ded6b9dd25f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.498206 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3527d-84e1-47f1-9800-0ded6b9dd25f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.498685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3527d-84e1-47f1-9800-0ded6b9dd25f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.500259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 30/59] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:35.505357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884201-b08c-4ed2-9a1f-373a1b143c70 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.505900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884201-b08c-4ed2-9a1f-373a1b143c70 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.506317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884201-b08c-4ed2-9a1f-373a1b143c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.511443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce17ca-673e-4151-8c1a-51269029a603 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:35.521509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:35.531906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f2884201-b08c-4ed2-9a1f-373a1b143c70 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:35.533118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f2884201-b08c-4ed2-9a1f-373a1b143c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:35.580633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22895b-1d82-4b5f-beca-cb13412e97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:35.581748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22895b-1d82-4b5f-beca-cb13412e97b0 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.582239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22895b-1d82-4b5f-beca-cb13412e97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.582515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22895b-1d82-4b5f-beca-cb13412e97b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.603432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:35.609509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22895b-1d82-4b5f-beca-cb13412e97b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:35.631527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 31/60] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:35.638677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2884201-b08c-4ed2-9a1f-373a1b143c70 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-1c22895b-1d82-4b5f-beca-cb13412e97b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:35.722191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:35.723135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:35.723910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:35.724537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a34272-0b51-44ca-971c-f9fba13b366d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.724800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a34272-0b51-44ca-971c-f9fba13b366d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.725097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a34272-0b51-44ca-971c-f9fba13b366d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.726688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 31/62] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:35.732599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d499f-7db9-44eb-b9a7-dbfb9ff0068e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.732881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d499f-7db9-44eb-b9a7-dbfb9ff0068e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.733149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d499f-7db9-44eb-b9a7-dbfb9ff0068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.755580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-db6d499f-7db9-44eb-b9a7-dbfb9ff0068e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:35.756972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-db6d499f-7db9-44eb-b9a7-dbfb9ff0068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:35.789908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2884201-b08c-4ed2-9a1f-373a1b143c70 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:35.826744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7faed4-d6fb-4989-8118-bb33b774a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:35.827796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7faed4-d6fb-4989-8118-bb33b774a60b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.828280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7faed4-d6fb-4989-8118-bb33b774a60b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.828826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7faed4-d6fb-4989-8118-bb33b774a60b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.833997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 32/63] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:35.834690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d499f-7db9-44eb-b9a7-dbfb9ff0068e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:35.842031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7faed4-d6fb-4989-8118-bb33b774a60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5f7faed4-d6fb-4989-8118-bb33b774a60b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:35.847315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:35.848165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:35.848970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:46:35.851369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 32/64] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:35.861676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7faed4-d6fb-4989-8118-bb33b774a60b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:35.934061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:35.940768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:35.950957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d499f-7db9-44eb-b9a7-dbfb9ff0068e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:35.995325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:35.995946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:35.996225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:35.996497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:35.997167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:35.997472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:35.998915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.006550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7faed4-d6fb-4989-8118-bb33b774a60b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.011553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 33/65] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.012265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.063501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cf0ff-dc87-43f8-b401-1620f97f4860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.064872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf0ff-dc87-43f8-b401-1620f97f4860 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.065539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf0ff-dc87-43f8-b401-1620f97f4860 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.066054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf0ff-dc87-43f8-b401-1620f97f4860 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.066863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cf0ff-dc87-43f8-b401-1620f97f4860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:36.067549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cf0ff-dc87-43f8-b401-1620f97f4860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.074104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cf0ff-dc87-43f8-b401-1620f97f4860 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.085208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 33/66] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:36.087132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352a7c-7c01-491b-84b8-e9a3abab92ba None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.087559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352a7c-7c01-491b-84b8-e9a3abab92ba None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.088351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352a7c-7c01-491b-84b8-e9a3abab92ba None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.090115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 34/67] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:36.094286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352a7c-7c01-491b-84b8-e9a3abab92ba None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.158895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ce8be-d2b5-4555-8fd3-cced534bddc1 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.195260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf38adf-2b22-42d3-aac1-1b8e0ffd3e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.195925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf38adf-2b22-42d3-aac1-1b8e0ffd3e01 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.196207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf38adf-2b22-42d3-aac1-1b8e0ffd3e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.196484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf38adf-2b22-42d3-aac1-1b8e0ffd3e01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.207409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf38adf-2b22-42d3-aac1-1b8e0ffd3e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-fbf38adf-2b22-42d3-aac1-1b8e0ffd3e01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:36.212825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:36.213986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:36.214880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 34/68] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:36.219552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf38adf-2b22-42d3-aac1-1b8e0ffd3e01 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.224656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:36.229721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352a7c-7c01-491b-84b8-e9a3abab92ba None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.236844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:36.268326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c76eb-28a4-4c39-9bb4-0b167a4335e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.269237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c76eb-28a4-4c39-9bb4-0b167a4335e3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.269544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c76eb-28a4-4c39-9bb4-0b167a4335e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.269823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c76eb-28a4-4c39-9bb4-0b167a4335e3 None admin] PATH_INFO: `/v3/users/e4a45d0a115d4bc794657fc46219ce4a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.285057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c76eb-28a4-4c39-9bb4-0b167a4335e3 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a45d0a115d4bc794657fc46219ce4a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.286532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c76eb-28a4-4c39-9bb4-0b167a4335e3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.288166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 35/69] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/users/e4a45d0a115d4bc794657fc46219ce4a => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.290067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c6366-6aeb-44ca-bc35-0ed40c518a25 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.290354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c6366-6aeb-44ca-bc35-0ed40c518a25 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.290621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c6366-6aeb-44ca-bc35-0ed40c518a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.309953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-834c6366-6aeb-44ca-bc35-0ed40c518a25 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:36.311169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-834c6366-6aeb-44ca-bc35-0ed40c518a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:36.339318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf38adf-2b22-42d3-aac1-1b8e0ffd3e01 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.374406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aaabb-4908-456b-9643-64fc5164a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.375042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aaabb-4908-456b-9643-64fc5164a936 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.375325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aaabb-4908-456b-9643-64fc5164a936 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.375609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aaabb-4908-456b-9643-64fc5164a936 None admin] PATH_INFO: `/v3/users/ced917b9e08744f88e2078e19eb8640b` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.376976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aaabb-4908-456b-9643-64fc5164a936 None admin] RBAC: Authorizing `identity:get_user(user_id=ced917b9e08744f88e2078e19eb8640b)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.378477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aaabb-4908-456b-9643-64fc5164a936 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.379771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 36/70] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:36.384754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/users/ced917b9e08744f88e2078e19eb8640b => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.384890 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c6366-6aeb-44ca-bc35-0ed40c518a25 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.384975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aaabb-4908-456b-9643-64fc5164a936 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.476662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:36.484661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:36.497738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c6366-6aeb-44ca-bc35-0ed40c518a25 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.498060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aaabb-4908-456b-9643-64fc5164a936 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.535194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8f799-3ab7-4605-85c9-54b3afa74dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.535358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.535733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.535835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8f799-3ab7-4605-85c9-54b3afa74dcd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.536005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.536098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8f799-3ab7-4605-85c9-54b3afa74dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.536280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8f799-3ab7-4605-85c9-54b3afa74dcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.536372 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.536944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:36.537248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.538745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.551671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 36/72] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.551806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8f799-3ab7-4605-85c9-54b3afa74dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:36.551882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a4d8f799-3ab7-4605-85c9-54b3afa74dcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:36.552695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:36.553797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:46:36.554673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 37/73] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:36.555370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8f799-3ab7-4605-85c9-54b3afa74dcd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.659979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dde2c-f257-42c1-b70e-5df41ee98267 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.661494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8f799-3ab7-4605-85c9-54b3afa74dcd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.693197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a50ad-c08e-4c37-963b-3f614d60091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.693864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a50ad-c08e-4c37-963b-3f614d60091f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.694149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a50ad-c08e-4c37-963b-3f614d60091f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.694452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a50ad-c08e-4c37-963b-3f614d60091f None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.696017 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d3b4-f53f-42e1-be17-76ed6c5d270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.696129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a50ad-c08e-4c37-963b-3f614d60091f None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.696643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d3b4-f53f-42e1-be17-76ed6c5d270d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.696917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d3b4-f53f-42e1-be17-76ed6c5d270d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.697186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7d3b4-f53f-42e1-be17-76ed6c5d270d None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.697658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a50ad-c08e-4c37-963b-3f614d60091f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.698343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7d3b4-f53f-42e1-be17-76ed6c5d270d None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.699314 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 37/74] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.699790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7d3b4-f53f-42e1-be17-76ed6c5d270d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.700070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a50ad-c08e-4c37-963b-3f614d60091f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.706367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 38/75] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.706367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d3b4-f53f-42e1-be17-76ed6c5d270d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.717436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:36.722614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:36.800787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a50ad-c08e-4c37-963b-3f614d60091f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.801944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7d3b4-f53f-42e1-be17-76ed6c5d270d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.833741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5104464-51ed-4a83-adae-2261af6ca27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.834368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104464-51ed-4a83-adae-2261af6ca27a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.834650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104464-51ed-4a83-adae-2261af6ca27a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.834925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5104464-51ed-4a83-adae-2261af6ca27a None admin] PATH_INFO: `/v3/users/e4a45d0a115d4bc794657fc46219ce4a` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.835035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.835574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.835851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.836082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5104464-51ed-4a83-adae-2261af6ca27a None admin] RBAC: Authorizing `identity:get_user(user_id=e4a45d0a115d4bc794657fc46219ce4a)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.836214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.837327 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:36.837660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.838136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5104464-51ed-4a83-adae-2261af6ca27a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.839019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.839781 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 38/76] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/users/e4a45d0a115d4bc794657fc46219ce4a => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.840564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5104464-51ed-4a83-adae-2261af6ca27a None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.851943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 39/77] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.852710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.918480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:36.930902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:36.937831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5104464-51ed-4a83-adae-2261af6ca27a None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.952509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700d046-3aae-42cc-aa0b-4f7f42a435c6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:36.971776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e422aa-321c-498d-a18a-f88daa09dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.972902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e422aa-321c-498d-a18a-f88daa09dc0a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.973182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e422aa-321c-498d-a18a-f88daa09dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.973455 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e422aa-321c-498d-a18a-f88daa09dc0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.974645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e422aa-321c-498d-a18a-f88daa09dc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.976079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e422aa-321c-498d-a18a-f88daa09dc0a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:36.977889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 39/78] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:36.978661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e422aa-321c-498d-a18a-f88daa09dc0a None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:36.989403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d213-29e1-40e8-9a61-8ea1ac7d47f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:36.990100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d213-29e1-40e8-9a61-8ea1ac7d47f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:36.990385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d213-29e1-40e8-9a61-8ea1ac7d47f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:36.990660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d213-29e1-40e8-9a61-8ea1ac7d47f4 None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/users/e4a45d0a115d4bc794657fc46219ce4a/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:36.993058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2d213-29e1-40e8-9a61-8ea1ac7d47f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=07dac6f39ae14d2bb0f24a58291ce28d, user_id=e4a45d0a115d4bc794657fc46219ce4a, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:36.994550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2d213-29e1-40e8-9a61-8ea1ac7d47f4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:37.006693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 40/79] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:36 2022] PUT /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/users/e4a45d0a115d4bc794657fc46219ce4a/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:46:37.017416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d213-29e1-40e8-9a61-8ea1ac7d47f4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:37.087671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e422aa-321c-498d-a18a-f88daa09dc0a None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:37.127053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b271f03-3d34-41f8-8f6a-c4577df05b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:37.127729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b271f03-3d34-41f8-8f6a-c4577df05b5b None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:37.128009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b271f03-3d34-41f8-8f6a-c4577df05b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:37.128285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b271f03-3d34-41f8-8f6a-c4577df05b5b None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/users/ced917b9e08744f88e2078e19eb8640b/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:37.130287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b271f03-3d34-41f8-8f6a-c4577df05b5b None admin] RBAC: Authorizing `identity:create_grant(project_id=07dac6f39ae14d2bb0f24a58291ce28d, user_id=ced917b9e08744f88e2078e19eb8640b, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:37.131830 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b271f03-3d34-41f8-8f6a-c4577df05b5b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:37.140313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d213-29e1-40e8-9a61-8ea1ac7d47f4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:37.149844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 40/80] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:36 2022] PUT /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/users/ced917b9e08744f88e2078e19eb8640b/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:46:37.150500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b271f03-3d34-41f8-8f6a-c4577df05b5b None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:37.166278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:37.199375 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0c5ee-c145-40e1-b4ac-d290452d06f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:37.199579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c5ee-c145-40e1-b4ac-d290452d06f7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:37.199827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c5ee-c145-40e1-b4ac-d290452d06f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:37.200105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0c5ee-c145-40e1-b4ac-d290452d06f7 None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:37.202191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0c5ee-c145-40e1-b4ac-d290452d06f7 None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:37.204165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0c5ee-c145-40e1-b4ac-d290452d06f7 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:37.206491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 41/81] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:37 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:37.209606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0c5ee-c145-40e1-b4ac-d290452d06f7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:37.220373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:37.297333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b271f03-3d34-41f8-8f6a-c4577df05b5b None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:37.326821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0c5ee-c145-40e1-b4ac-d290452d06f7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:37.347702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940a857-5862-436d-ac05-81f9861428eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:37.348268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a857-5862-436d-ac05-81f9861428eb None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:37.348548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a857-5862-436d-ac05-81f9861428eb None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:37.348821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940a857-5862-436d-ac05-81f9861428eb None admin] PATH_INFO: `/v3/users/e4a45d0a115d4bc794657fc46219ce4a` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:37.350200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940a857-5862-436d-ac05-81f9861428eb None admin] RBAC: Authorizing `identity:get_user(user_id=e4a45d0a115d4bc794657fc46219ce4a)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:37.352461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940a857-5862-436d-ac05-81f9861428eb None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:37.354497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 41/82] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:37 2022] GET /identity/v3/users/e4a45d0a115d4bc794657fc46219ce4a => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:37.355171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940a857-5862-436d-ac05-81f9861428eb None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:37.372604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050213-2c79-4c71-ab8e-df84fbb01928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:37.373283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050213-2c79-4c71-ab8e-df84fbb01928 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:37.373629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050213-2c79-4c71-ab8e-df84fbb01928 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:37.373909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050213-2c79-4c71-ab8e-df84fbb01928 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:37.374626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050213-2c79-4c71-ab8e-df84fbb01928 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:37.377017 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050213-2c79-4c71-ab8e-df84fbb01928 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:37.402474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 42/83] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:46:37 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:37.403671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050213-2c79-4c71-ab8e-df84fbb01928 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:37.449077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:37.508678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940a857-5862-436d-ac05-81f9861428eb None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:37.513886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:37.579038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050213-2c79-4c71-ab8e-df84fbb01928 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:37.587721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a547a-d361-4fda-a795-0f2e8eb13a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:37.588400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a547a-d361-4fda-a795-0f2e8eb13a6d None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:37.589824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a547a-d361-4fda-a795-0f2e8eb13a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:37.590111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a547a-d361-4fda-a795-0f2e8eb13a6d None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/users/e4a45d0a115d4bc794657fc46219ce4a/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:37.597577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a547a-d361-4fda-a795-0f2e8eb13a6d None admin] RBAC: Authorizing `identity:create_grant(project_id=07dac6f39ae14d2bb0f24a58291ce28d, user_id=e4a45d0a115d4bc794657fc46219ce4a, role_id=7d7ee6a7e93f46e5bff0a079bfb7ea3e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:37.599433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a547a-d361-4fda-a795-0f2e8eb13a6d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:37.614545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 42/84] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:37 2022] PUT /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/users/e4a45d0a115d4bc794657fc46219ce4a/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:46:37.632505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6a8c0-2a1e-4907-8482-f6b964e9753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:37.633620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6a8c0-2a1e-4907-8482-f6b964e9753c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:37.634170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6a8c0-2a1e-4907-8482-f6b964e9753c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:37.634646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6a8c0-2a1e-4907-8482-f6b964e9753c None admin] PATH_INFO: `/v3/projects/9635f670218340608c0fc4e52f4b6be3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:37.636316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6a8c0-2a1e-4907-8482-f6b964e9753c None admin] RBAC: Authorizing `identity:get_project(project_id=9635f670218340608c0fc4e52f4b6be3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:37.638255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6a8c0-2a1e-4907-8482-f6b964e9753c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:37.640426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 43/85] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:37 2022] GET /identity/v3/projects/9635f670218340608c0fc4e52f4b6be3 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:37.646647 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a547a-d361-4fda-a795-0f2e8eb13a6d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:37.767041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a547a-d361-4fda-a795-0f2e8eb13a6d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:37.807193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d5a62-9025-467c-816d-c7d3ed71d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:37.807876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5a62-9025-467c-816d-c7d3ed71d8ba None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:37.808160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5a62-9025-467c-816d-c7d3ed71d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:37.808438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5a62-9025-467c-816d-c7d3ed71d8ba None admin] PATH_INFO: `/v3/projects/9635f670218340608c0fc4e52f4b6be3/users/e4a45d0a115d4bc794657fc46219ce4a/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:37.812888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d5a62-9025-467c-816d-c7d3ed71d8ba None admin] RBAC: Authorizing `identity:create_grant(project_id=9635f670218340608c0fc4e52f4b6be3, user_id=e4a45d0a115d4bc794657fc46219ce4a, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:37.814452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d5a62-9025-467c-816d-c7d3ed71d8ba None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:37.817976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:37.833163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 43/86] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:37 2022] PUT /identity/v3/projects/9635f670218340608c0fc4e52f4b6be3/users/e4a45d0a115d4bc794657fc46219ce4a/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:46:39.612336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e70b-fa94-4cb8-9b17-dbc3b552460a None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:39.613458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e70b-fa94-4cb8-9b17-dbc3b552460a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:39.614075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e70b-fa94-4cb8-9b17-dbc3b552460a None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:39.615797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 44/87] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:39.621896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f2de-735f-4457-b3ad-ebcb2c11cc0c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:39.622689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f2de-735f-4457-b3ad-ebcb2c11cc0c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:39.623158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82f2de-735f-4457-b3ad-ebcb2c11cc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:39.650690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-bf82f2de-735f-4457-b3ad-ebcb2c11cc0c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:39.652375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bf82f2de-735f-4457-b3ad-ebcb2c11cc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:39.737097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 44/88] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:40.277928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481e70b-fa94-4cb8-9b17-dbc3b552460a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:40.368076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730ca01-0532-48b0-be53-7f0f9f428f5d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.368700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730ca01-0532-48b0-be53-7f0f9f428f5d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.369202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730ca01-0532-48b0-be53-7f0f9f428f5d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.370760 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 45/89] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:40.376817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf54ff-b5ce-42cf-8273-7ca9333e652a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.377408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf54ff-b5ce-42cf-8273-7ca9333e652a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.377908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf54ff-b5ce-42cf-8273-7ca9333e652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.414142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-53bf54ff-b5ce-42cf-8273-7ca9333e652a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:40.415344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-53bf54ff-b5ce-42cf-8273-7ca9333e652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:40.421835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481e70b-fa94-4cb8-9b17-dbc3b552460a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:40.466173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:40.473314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5b73c-ab80-4240-ae3c-cb14614a9dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:40.473974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b73c-ab80-4240-ae3c-cb14614a9dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.474253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b73c-ab80-4240-ae3c-cb14614a9dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.474523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b73c-ab80-4240-ae3c-cb14614a9dd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.485647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5b73c-ab80-4240-ae3c-cb14614a9dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-bce5b73c-ab80-4240-ae3c-cb14614a9dd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:40.490977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:40.491832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:46:40.492619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 45/90] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:40.497804 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5b73c-ab80-4240-ae3c-cb14614a9dd8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:40.548291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 46/91] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:40.658195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5b73c-ab80-4240-ae3c-cb14614a9dd8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:40.700258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e216ae-3667-4b91-b45e-012fa58175f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:40.701142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e216ae-3667-4b91-b45e-012fa58175f9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.701436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e216ae-3667-4b91-b45e-012fa58175f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.701729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e216ae-3667-4b91-b45e-012fa58175f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.702400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e216ae-3667-4b91-b45e-012fa58175f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:40.702704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e216ae-3667-4b91-b45e-012fa58175f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:40.704097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e216ae-3667-4b91-b45e-012fa58175f9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:40.718126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 46/92] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:40.723868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf54ff-b5ce-42cf-8273-7ca9333e652a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:40.728048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c74-c5dd-4126-9bbd-ae96fd0c074c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.728546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c74-c5dd-4126-9bbd-ae96fd0c074c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.728823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713c74-c5dd-4126-9bbd-ae96fd0c074c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.730250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 47/93] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:40.747404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aaedb-813f-4f33-a67a-6c7cf1da7f74 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.747705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aaedb-813f-4f33-a67a-6c7cf1da7f74 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.747963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aaedb-813f-4f33-a67a-6c7cf1da7f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.782557 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-306aaedb-813f-4f33-a67a-6c7cf1da7f74 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:40.783785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-306aaedb-813f-4f33-a67a-6c7cf1da7f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:40.797573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:40.873002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:40.873309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf54ff-b5ce-42cf-8273-7ca9333e652a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:40.905705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 48/94] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:40.907396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5233-c76f-4c0d-9c11-7f43859deb60 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.907683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5233-c76f-4c0d-9c11-7f43859deb60 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.907961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5233-c76f-4c0d-9c11-7f43859deb60 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.909506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 49/95] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:40.911025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937526f-e2db-4751-a5a0-55bd0952d9ff None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.911312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937526f-e2db-4751-a5a0-55bd0952d9ff None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.911585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937526f-e2db-4751-a5a0-55bd0952d9ff None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.912924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 50/96] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:40.918782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef09022-a523-4e13-b3a7-040caf95ec17 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.919077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef09022-a523-4e13-b3a7-040caf95ec17 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.919352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef09022-a523-4e13-b3a7-040caf95ec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.939145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0ccd0-c77d-4252-8be5-934379e7cb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:40.939472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fef09022-a523-4e13-b3a7-040caf95ec17 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:40.939789 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0ccd0-c77d-4252-8be5-934379e7cb06 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.940069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0ccd0-c77d-4252-8be5-934379e7cb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.940346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0ccd0-c77d-4252-8be5-934379e7cb06 None admin] PATH_INFO: `/v3/users/e4a45d0a115d4bc794657fc46219ce4a` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.940567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fef09022-a523-4e13-b3a7-040caf95ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:40.941533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0ccd0-c77d-4252-8be5-934379e7cb06 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a45d0a115d4bc794657fc46219ce4a)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:40.943083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0ccd0-c77d-4252-8be5-934379e7cb06 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:40.945074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 47/97] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:40 2022] GET /identity/v3/users/e4a45d0a115d4bc794657fc46219ce4a => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:40.946268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8133e4-fd11-4fc9-bb48-da48d39d4d25 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:40.946551 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8133e4-fd11-4fc9-bb48-da48d39d4d25 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:40.946826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8133e4-fd11-4fc9-bb48-da48d39d4d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:40.990032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9b8133e4-fd11-4fc9-bb48-da48d39d4d25 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:40.991466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9b8133e4-fd11-4fc9-bb48-da48d39d4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:41.054498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 51/98] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:41.055962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef09022-a523-4e13-b3a7-040caf95ec17 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.066285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 48/99] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:41.067294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8133e4-fd11-4fc9-bb48-da48d39d4d25 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.182049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:41.249051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef09022-a523-4e13-b3a7-040caf95ec17 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.269191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:41.278224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8133e4-fd11-4fc9-bb48-da48d39d4d25 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.291193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3251127-e854-4d9a-835f-05f11be5f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:41.292105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3251127-e854-4d9a-835f-05f11be5f52b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.292576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3251127-e854-4d9a-835f-05f11be5f52b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.293099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3251127-e854-4d9a-835f-05f11be5f52b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.354226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b07f3-f518-4a1c-afdb-0f55b0fd5277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:41.354866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b07f3-f518-4a1c-afdb-0f55b0fd5277 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.355142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b07f3-f518-4a1c-afdb-0f55b0fd5277 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.355411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b07f3-f518-4a1c-afdb-0f55b0fd5277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.370176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3251127-e854-4d9a-835f-05f11be5f52b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:41.372057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3251127-e854-4d9a-835f-05f11be5f52b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:41.393516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b07f3-f518-4a1c-afdb-0f55b0fd5277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-0d1b07f3-f518-4a1c-afdb-0f55b0fd5277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:41.395913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:41.396744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:41.397540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:41.399493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 49/100] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:41.400970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b07f3-f518-4a1c-afdb-0f55b0fd5277 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.514450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 52/101] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:46:41.515214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3251127-e854-4d9a-835f-05f11be5f52b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.525193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b07f3-f518-4a1c-afdb-0f55b0fd5277 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.528659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:41.539692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:41.560590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5a14-c037-4fcf-ab31-9740ba3663a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:41.561223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5a14-c037-4fcf-ab31-9740ba3663a3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.561519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5a14-c037-4fcf-ab31-9740ba3663a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.561804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5a14-c037-4fcf-ab31-9740ba3663a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.572528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c5a14-c037-4fcf-ab31-9740ba3663a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-fd4c5a14-c037-4fcf-ab31-9740ba3663a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:41.577354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:41.578234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:41.578974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 50/102] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:41.579628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5a14-c037-4fcf-ab31-9740ba3663a3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.613152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3251127-e854-4d9a-835f-05f11be5f52b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.646581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:41.647189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.647472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.647748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.648915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:41.649223 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:41.650657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:41.658724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 53/103] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:41.659339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.685324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5a14-c037-4fcf-ab31-9740ba3663a3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.719365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7a978-8cd1-46ee-b2a8-93f9999509d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:41.719983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7a978-8cd1-46ee-b2a8-93f9999509d9 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.720257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7a978-8cd1-46ee-b2a8-93f9999509d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.720527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7a978-8cd1-46ee-b2a8-93f9999509d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.731685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7a978-8cd1-46ee-b2a8-93f9999509d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:41.733970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-b4a7a978-8cd1-46ee-b2a8-93f9999509d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:41.736723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:41.737764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:41.738534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 51/104] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:41.739197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b767e-c1bb-4358-9cd1-00e96315368e None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.739197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b767e-c1bb-4358-9cd1-00e96315368e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.739899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b767e-c1bb-4358-9cd1-00e96315368e None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.740892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 52/105] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:41.741623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b767e-c1bb-4358-9cd1-00e96315368e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.763622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf45b7c-2a77-4129-a0cf-f9184b6ed407 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.776980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:41.798373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fb11b-ff35-4b00-b7b3-fc8d1e00b4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:41.799059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fb11b-ff35-4b00-b7b3-fc8d1e00b4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.799350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fb11b-ff35-4b00-b7b3-fc8d1e00b4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.799626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fb11b-ff35-4b00-b7b3-fc8d1e00b4e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.809689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fb11b-ff35-4b00-b7b3-fc8d1e00b4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-069fb11b-ff35-4b00-b7b3-fc8d1e00b4e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:41.814875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:41.815813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:46:41.816605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 54/106] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:41.817252 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fb11b-ff35-4b00-b7b3-fc8d1e00b4e7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.845096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b767e-c1bb-4358-9cd1-00e96315368e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.878053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441f78a-c54a-46fb-bc01-f9c2d9784a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:41.878676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f78a-c54a-46fb-bc01-f9c2d9784a3b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.878960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f78a-c54a-46fb-bc01-f9c2d9784a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.879236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f78a-c54a-46fb-bc01-f9c2d9784a3b None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.880366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441f78a-c54a-46fb-bc01-f9c2d9784a3b None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:41.881851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441f78a-c54a-46fb-bc01-f9c2d9784a3b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:41.884011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 53/107] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:41.884872 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441f78a-c54a-46fb-bc01-f9c2d9784a3b None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.916622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fb11b-ff35-4b00-b7b3-fc8d1e00b4e7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.951255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:41.951862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:41.952147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:41.952418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:41.953083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:41.953386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:41.954843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:41.956158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:41.964293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 55/108] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:41.964293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:41.983897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441f78a-c54a-46fb-bc01-f9c2d9784a3b None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:41.985782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.018701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843a59-2f60-4f79-93e7-b554ed84c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.019328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843a59-2f60-4f79-93e7-b554ed84c51a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.019610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843a59-2f60-4f79-93e7-b554ed84c51a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.019884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843a59-2f60-4f79-93e7-b554ed84c51a None admin] PATH_INFO: `/v3/users/ced917b9e08744f88e2078e19eb8640b` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.021002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56843a59-2f60-4f79-93e7-b554ed84c51a None admin] RBAC: Authorizing `identity:get_user(user_id=ced917b9e08744f88e2078e19eb8640b)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.022479 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56843a59-2f60-4f79-93e7-b554ed84c51a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.024334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 54/109] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/users/ced917b9e08744f88e2078e19eb8640b => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.025320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d983-b0a0-44cb-a3f4-2ecb2b840dde None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.025630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d983-b0a0-44cb-a3f4-2ecb2b840dde None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.025906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d983-b0a0-44cb-a3f4-2ecb2b840dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.043463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0bc1d983-b0a0-44cb-a3f4-2ecb2b840dde None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:42.044594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0bc1d983-b0a0-44cb-a3f4-2ecb2b840dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:42.072872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677058-636d-4e67-a186-09827f0a5940 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.106062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.106675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.106988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.107265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.107932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:42.108242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.109940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.110906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 55/110] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:42.111731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1d983-b0a0-44cb-a3f4-2ecb2b840dde None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.118603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 56/111] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.122389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.182970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.225706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3390722-49b4-4fc3-a60a-fa907238c14b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.232518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.235944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1d983-b0a0-44cb-a3f4-2ecb2b840dde None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.262339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.262953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.263237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.263519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.264244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] RBAC: Adding query filter params (role.id=a754d895803642e894fc6ccc699d51d9, scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d, user.id=e4a45d0a115d4bc794657fc46219ce4a) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:42.264559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.266053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.271542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.272148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.272429 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.272702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.273045 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 57/112] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/role_assignments?user.id=e4a45d0a115d4bc794657fc46219ce4a&scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d&role.id=a754d895803642e894fc6ccc699d51d9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.281875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:42.281875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.282068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.282149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.290430 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 56/113] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.291493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.405639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d61294-9a9d-4740-b4c5-d56a885b7d5e None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.418629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043574-d342-4193-bf98-0940ee390c4b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.444478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9298a-ddf8-4dcf-999d-f9e8612b0496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.445103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9298a-ddf8-4dcf-999d-f9e8612b0496 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.445456 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9298a-ddf8-4dcf-999d-f9e8612b0496 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.445770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9298a-ddf8-4dcf-999d-f9e8612b0496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.446851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.459113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae345e-2ebd-4b82-adfe-1ed06061cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.459760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae345e-2ebd-4b82-adfe-1ed06061cafe None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.460047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae345e-2ebd-4b82-adfe-1ed06061cafe None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.460324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae345e-2ebd-4b82-adfe-1ed06061cafe None admin] PATH_INFO: `/v3/users/6daa4a8d535246ec9d52638d92ef8d0f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.475355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae345e-2ebd-4b82-adfe-1ed06061cafe None admin] RBAC: Authorizing `identity:get_user(user_id=6daa4a8d535246ec9d52638d92ef8d0f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.476990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae345e-2ebd-4b82-adfe-1ed06061cafe None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.478913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 58/114] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/users/6daa4a8d535246ec9d52638d92ef8d0f => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.479492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae345e-2ebd-4b82-adfe-1ed06061cafe None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.489070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.531674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9298a-ddf8-4dcf-999d-f9e8612b0496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.533155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9298a-ddf8-4dcf-999d-f9e8612b0496 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.586900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae345e-2ebd-4b82-adfe-1ed06061cafe None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.619458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59691-5881-401c-8511-fa89e1c96a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.620081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59691-5881-401c-8511-fa89e1c96a36 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.620357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59691-5881-401c-8511-fa89e1c96a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.620634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e59691-5881-401c-8511-fa89e1c96a36 None admin] PATH_INFO: `/v3/users/e4a45d0a115d4bc794657fc46219ce4a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.621803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e59691-5881-401c-8511-fa89e1c96a36 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a45d0a115d4bc794657fc46219ce4a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.623237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e59691-5881-401c-8511-fa89e1c96a36 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.624797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 59/115] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/users/e4a45d0a115d4bc794657fc46219ce4a => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.629370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59691-5881-401c-8511-fa89e1c96a36 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.634392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 57/116] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:46:42.635085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9298a-ddf8-4dcf-999d-f9e8612b0496 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.673783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.693306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.725379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e59691-5881-401c-8511-fa89e1c96a36 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.732681 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9298a-ddf8-4dcf-999d-f9e8612b0496 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.758421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ff008-2110-4c7c-908a-d65f38f77f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.759045 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ff008-2110-4c7c-908a-d65f38f77f56 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.759325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ff008-2110-4c7c-908a-d65f38f77f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.759600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ff008-2110-4c7c-908a-d65f38f77f56 None admin] PATH_INFO: `/v3/users/e4a45d0a115d4bc794657fc46219ce4a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.760723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ff008-2110-4c7c-908a-d65f38f77f56 None admin] RBAC: Authorizing `identity:get_user(user_id=e4a45d0a115d4bc794657fc46219ce4a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.762204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ff008-2110-4c7c-908a-d65f38f77f56 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.763778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 60/117] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/users/e4a45d0a115d4bc794657fc46219ce4a => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.764533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ff008-2110-4c7c-908a-d65f38f77f56 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.770565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b5f7c-390b-4383-ab20-6936cd9acad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.771189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b5f7c-390b-4383-ab20-6936cd9acad3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.771469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b5f7c-390b-4383-ab20-6936cd9acad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.771741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b5f7c-390b-4383-ab20-6936cd9acad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.772868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b5f7c-390b-4383-ab20-6936cd9acad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.774870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b5f7c-390b-4383-ab20-6936cd9acad3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.776422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 58/118] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.778273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b5f7c-390b-4383-ab20-6936cd9acad3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.863871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ff008-2110-4c7c-908a-d65f38f77f56 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.876382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b5f7c-390b-4383-ab20-6936cd9acad3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:42.878994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.897666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3af9d-1bb3-4a51-86df-5db52670dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.898346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3af9d-1bb3-4a51-86df-5db52670dcaa None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.899138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3af9d-1bb3-4a51-86df-5db52670dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.899425 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3af9d-1bb3-4a51-86df-5db52670dcaa None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.900555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3af9d-1bb3-4a51-86df-5db52670dcaa None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.902062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3af9d-1bb3-4a51-86df-5db52670dcaa None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:42.903695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 61/119] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:42.904449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3af9d-1bb3-4a51-86df-5db52670dcaa None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:42.905019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:42.914082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd48bd-89e4-4550-8858-f6a67875bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:42.914691 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd48bd-89e4-4550-8858-f6a67875bf1e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:42.914974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd48bd-89e4-4550-8858-f6a67875bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:42.915245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd48bd-89e4-4550-8858-f6a67875bf1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:42.983375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd48bd-89e4-4550-8858-f6a67875bf1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:42.985099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd48bd-89e4-4550-8858-f6a67875bf1e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.005221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3af9d-1bb3-4a51-86df-5db52670dcaa None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.037846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba69c5-0722-429a-b931-7536856b8fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.038469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba69c5-0722-429a-b931-7536856b8fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.038746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba69c5-0722-429a-b931-7536856b8fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.039137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba69c5-0722-429a-b931-7536856b8fa1 None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.040238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba69c5-0722-429a-b931-7536856b8fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.041709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba69c5-0722-429a-b931-7536856b8fa1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.043313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 62/120] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:43.044062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba69c5-0722-429a-b931-7536856b8fa1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:43.091882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 59/121] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:46:43.092698 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd48bd-89e4-4550-8858-f6a67875bf1e None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:43.097433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:43.121824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:43.146687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba69c5-0722-429a-b931-7536856b8fa1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.179955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464d3e-abae-4767-a645-1462d0e9f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.180591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d3e-abae-4767-a645-1462d0e9f094 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.180902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d3e-abae-4767-a645-1462d0e9f094 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.181177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30464d3e-abae-4767-a645-1462d0e9f094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.190624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd48bd-89e4-4550-8858-f6a67875bf1e None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.223726 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08514-dd81-4609-9b67-3286a70248d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.224323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08514-dd81-4609-9b67-3286a70248d3 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.224601 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08514-dd81-4609-9b67-3286a70248d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.224874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c08514-dd81-4609-9b67-3286a70248d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.225549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08514-dd81-4609-9b67-3286a70248d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.227364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c08514-dd81-4609-9b67-3286a70248d3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.247079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464d3e-abae-4767-a645-1462d0e9f094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.248619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30464d3e-abae-4767-a645-1462d0e9f094 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.253823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 60/122] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:46:43 2022] POST /identity/v3/projects => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:43.254603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08514-dd81-4609-9b67-3286a70248d3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:43.305097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:43.350360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:43.370126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 63/123] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:46:43.370126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464d3e-abae-4767-a645-1462d0e9f094 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:43.372961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c08514-dd81-4609-9b67-3286a70248d3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.409599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede753-ad31-4e86-a780-0d614872b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.410437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede753-ad31-4e86-a780-0d614872b81d None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.410721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede753-ad31-4e86-a780-0d614872b81d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.410995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ede753-ad31-4e86-a780-0d614872b81d None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/users/6daa4a8d535246ec9d52638d92ef8d0f/roles/d7cac0839e014250a46eec827e0e2256` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.413014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede753-ad31-4e86-a780-0d614872b81d None admin] RBAC: Authorizing `identity:create_grant(project_id=07dac6f39ae14d2bb0f24a58291ce28d, user_id=6daa4a8d535246ec9d52638d92ef8d0f, role_id=d7cac0839e014250a46eec827e0e2256)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.415073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ede753-ad31-4e86-a780-0d614872b81d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.430649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 61/124] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:43 2022] PUT /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/users/6daa4a8d535246ec9d52638d92ef8d0f/roles/d7cac0839e014250a46eec827e0e2256 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:46:43.431656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede753-ad31-4e86-a780-0d614872b81d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:43.496224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30464d3e-abae-4767-a645-1462d0e9f094 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.543265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.543811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.544093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.544370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.545860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d, user.id=ced917b9e08744f88e2078e19eb8640b) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:43.546177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.548160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.557637 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 64/125] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:46:43 2022] GET /identity/v3/role_assignments?user.id=ced917b9e08744f88e2078e19eb8640b&scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:43.562492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:43.596691 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ede753-ad31-4e86-a780-0d614872b81d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.611057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:43.651509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c366af-1eb1-432e-a805-0169a8b914cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.652167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c366af-1eb1-432e-a805-0169a8b914cd None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.652445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c366af-1eb1-432e-a805-0169a8b914cd None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.652718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c366af-1eb1-432e-a805-0169a8b914cd None admin] PATH_INFO: `/v3/projects/9635f670218340608c0fc4e52f4b6be3` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.654777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c366af-1eb1-432e-a805-0169a8b914cd None admin] RBAC: Authorizing `identity:get_project(project_id=9635f670218340608c0fc4e52f4b6be3)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.656591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c366af-1eb1-432e-a805-0169a8b914cd None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.658612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 62/126] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:43 2022] GET /identity/v3/projects/9635f670218340608c0fc4e52f4b6be3 => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:43.665459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c366af-1eb1-432e-a805-0169a8b914cd None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:43.687324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:43.727870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241c76-9ed2-4e20-ba26-5138dc23f2f0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.781064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3066569-e404-458a-8883-a550ea2131e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.781775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066569-e404-458a-8883-a550ea2131e1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.782052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066569-e404-458a-8883-a550ea2131e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.782332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066569-e404-458a-8883-a550ea2131e1 None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.783496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066569-e404-458a-8883-a550ea2131e1 None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.785065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066569-e404-458a-8883-a550ea2131e1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.786646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 65/127] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:43 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:43.793449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3066569-e404-458a-8883-a550ea2131e1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:43.802946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c366af-1eb1-432e-a805-0169a8b914cd None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.850936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0e83b-853e-40c2-8b17-ae75830b621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.852204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e83b-853e-40c2-8b17-ae75830b621e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.852916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e83b-853e-40c2-8b17-ae75830b621e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.853373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0e83b-853e-40c2-8b17-ae75830b621e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.854829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e83b-853e-40c2-8b17-ae75830b621e None admin] RBAC: Adding query filter params (role.id=a754d895803642e894fc6ccc699d51d9, scope.project.id=9635f670218340608c0fc4e52f4b6be3, user.id=e4a45d0a115d4bc794657fc46219ce4a) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:43.855324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e83b-853e-40c2-8b17-ae75830b621e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.857519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0e83b-853e-40c2-8b17-ae75830b621e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.866374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 63/128] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:46:43 2022] GET /identity/v3/role_assignments?user.id=e4a45d0a115d4bc794657fc46219ce4a&scope.project.id=9635f670218340608c0fc4e52f4b6be3&role.id=a754d895803642e894fc6ccc699d51d9 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:43.905067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:43.924241 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3066569-e404-458a-8883-a550ea2131e1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:43.964426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73baa070-9964-4094-91cc-acc2ac012d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:43.965734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baa070-9964-4094-91cc-acc2ac012d36 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:43.966250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baa070-9964-4094-91cc-acc2ac012d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:43.966701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baa070-9964-4094-91cc-acc2ac012d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:43.967667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73baa070-9964-4094-91cc-acc2ac012d36 None admin] RBAC: Adding query filter params (role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e, scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d, user.id=e4a45d0a115d4bc794657fc46219ce4a) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:43.968162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73baa070-9964-4094-91cc-acc2ac012d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:43.969924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73baa070-9964-4094-91cc-acc2ac012d36 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:43.977619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 66/129] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:46:43 2022] GET /identity/v3/role_assignments?user.id=e4a45d0a115d4bc794657fc46219ce4a&scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d&role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:45.565548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a20cd-1ec4-442b-8b47-c56f9f8ba4db None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:45.566056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a20cd-1ec4-442b-8b47-c56f9f8ba4db None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:45.566136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a20cd-1ec4-442b-8b47-c56f9f8ba4db None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:45.567454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 64/130] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:45.572889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384719-06e9-42b2-8054-b6d9bf621d3d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:45.573289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384719-06e9-42b2-8054-b6d9bf621d3d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:45.573584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15384719-06e9-42b2-8054-b6d9bf621d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:45.591457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-15384719-06e9-42b2-8054-b6d9bf621d3d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:45.592637 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-15384719-06e9-42b2-8054-b6d9bf621d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:45.662109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 67/131] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:45.743718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e37f-f69a-4011-87d7-54deef0c2b06 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:45.744005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e37f-f69a-4011-87d7-54deef0c2b06 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:45.744283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e37f-f69a-4011-87d7-54deef0c2b06 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:45.745654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 65/132] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:45.750988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361744-0d7d-4395-b61b-d652e6696a97 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:45.751280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361744-0d7d-4395-b61b-d652e6696a97 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:45.751561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52361744-0d7d-4395-b61b-d652e6696a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:45.770422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-52361744-0d7d-4395-b61b-d652e6696a97 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:45.771607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-52361744-0d7d-4395-b61b-d652e6696a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:45.836445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 68/133] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:45.936922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e37f-f69a-4011-87d7-54deef0c2b06 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:46.024041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:46.050161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e37f-f69a-4011-87d7-54deef0c2b06 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:46.082818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128f6b6-6ebf-43c0-a611-0f51c6e0abfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:46.083443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f6b6-6ebf-43c0-a611-0f51c6e0abfd None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:46.083720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f6b6-6ebf-43c0-a611-0f51c6e0abfd None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:46.083992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128f6b6-6ebf-43c0-a611-0f51c6e0abfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:46.085081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128f6b6-6ebf-43c0-a611-0f51c6e0abfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:46.087285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128f6b6-6ebf-43c0-a611-0f51c6e0abfd None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:46.089793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 66/134] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:46.095217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52361744-0d7d-4395-b61b-d652e6696a97 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:46.101244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128f6b6-6ebf-43c0-a611-0f51c6e0abfd None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:46.105870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:46.195734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52361744-0d7d-4395-b61b-d652e6696a97 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:46.199376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128f6b6-6ebf-43c0-a611-0f51c6e0abfd None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:46.228190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfd23-6d62-4eda-9998-3b4626d44c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:46.228795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd23-6d62-4eda-9998-3b4626d44c76 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:46.229072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd23-6d62-4eda-9998-3b4626d44c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:46.229347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd23-6d62-4eda-9998-3b4626d44c76 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:46.230031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bfd23-6d62-4eda-9998-3b4626d44c76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:46.231463 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bfd23-6d62-4eda-9998-3b4626d44c76 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:46.231559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6096-07b7-41e5-bdc5-05e58dee3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:46.232091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6096-07b7-41e5-bdc5-05e58dee3266 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:46.232373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6096-07b7-41e5-bdc5-05e58dee3266 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:46.232648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6096-07b7-41e5-bdc5-05e58dee3266 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:46.243554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d6096-07b7-41e5-bdc5-05e58dee3266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-861d6096-07b7-41e5-bdc5-05e58dee3266 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:46.249137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:46.250063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:46.250835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 67/135] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:46:46.265513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 69/136] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:46:46 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:46:46.265724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6096-07b7-41e5-bdc5-05e58dee3266 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:46.265724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:46.364058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6096-07b7-41e5-bdc5-05e58dee3266 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:46.398954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:46.399582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:46.399864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:46.400173 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:46.400827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:46.401139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:46.402599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:46.411402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 68/137] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:46.417755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfd23-6d62-4eda-9998-3b4626d44c76 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:46.485180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:46.527723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfd23-6d62-4eda-9998-3b4626d44c76 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:46.569227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dee98c-0cf2-4e76-8e35-0f9c90788d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:46.570020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dee98c-0cf2-4e76-8e35-0f9c90788d6c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:46.570324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dee98c-0cf2-4e76-8e35-0f9c90788d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:46.570604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dee98c-0cf2-4e76-8e35-0f9c90788d6c None admin] PATH_INFO: `/v3/users/6daa4a8d535246ec9d52638d92ef8d0f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:46.571774 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dee98c-0cf2-4e76-8e35-0f9c90788d6c None admin] RBAC: Authorizing `identity:get_user(user_id=6daa4a8d535246ec9d52638d92ef8d0f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:46.573237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dee98c-0cf2-4e76-8e35-0f9c90788d6c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:46.574888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 70/138] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:46 2022] GET /identity/v3/users/6daa4a8d535246ec9d52638d92ef8d0f => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:46.581365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:46.655469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:46.711901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e36d2-be54-4309-a602-7e4b754a7a46 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:46.752492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64202f7a-0f86-4769-9484-8eb756ddf2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:46.753119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64202f7a-0f86-4769-9484-8eb756ddf2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:46.753398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64202f7a-0f86-4769-9484-8eb756ddf2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:46.753750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64202f7a-0f86-4769-9484-8eb756ddf2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:46.830097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64202f7a-0f86-4769-9484-8eb756ddf2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:46.831584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64202f7a-0f86-4769-9484-8eb756ddf2a8 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:46.896801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:46.937415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 69/139] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 12:46:46.943315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dee98c-0cf2-4e76-8e35-0f9c90788d6c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:47.052026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dee98c-0cf2-4e76-8e35-0f9c90788d6c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:47.083344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:47.091361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ab37-1b62-4692-96aa-9b4207bda579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:47.092014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ab37-1b62-4692-96aa-9b4207bda579 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:47.092292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ab37-1b62-4692-96aa-9b4207bda579 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:47.092560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ab37-1b62-4692-96aa-9b4207bda579 None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:47.093753 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46ab37-1b62-4692-96aa-9b4207bda579 None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:47.095205 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46ab37-1b62-4692-96aa-9b4207bda579 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:47.101588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 71/140] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:46 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:47.103208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64202f7a-0f86-4769-9484-8eb756ddf2a8 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:47.204600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64202f7a-0f86-4769-9484-8eb756ddf2a8 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:47.239728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98e6a9-5ece-479d-8466-4af0165033e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:47.240334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e6a9-5ece-479d-8466-4af0165033e0 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:47.240613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e6a9-5ece-479d-8466-4af0165033e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:47.240885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e6a9-5ece-479d-8466-4af0165033e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:47.241646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98e6a9-5ece-479d-8466-4af0165033e0 None admin] RBAC: Adding query filter params (role.id=d7cac0839e014250a46eec827e0e2256, scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d, user.id=6daa4a8d535246ec9d52638d92ef8d0f) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:47.241984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98e6a9-5ece-479d-8466-4af0165033e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:47.243485 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98e6a9-5ece-479d-8466-4af0165033e0 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:47.249953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 70/141] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:46:47 2022] GET /identity/v3/role_assignments?user.id=6daa4a8d535246ec9d52638d92ef8d0f&scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d&role.id=d7cac0839e014250a46eec827e0e2256 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:48.558565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75796975-1a25-48f5-9555-36db3ff115fe None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:48.559170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75796975-1a25-48f5-9555-36db3ff115fe None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:48.559170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75796975-1a25-48f5-9555-36db3ff115fe None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:48.560588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 72/142] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:48.565678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeacf9-0c99-4597-aa6c-bd3381d8e8e3 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:48.566066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeacf9-0c99-4597-aa6c-bd3381d8e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:48.566228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdeacf9-0c99-4597-aa6c-bd3381d8e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:48.586608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-fcdeacf9-0c99-4597-aa6c-bd3381d8e8e3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:48.587855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-fcdeacf9-0c99-4597-aa6c-bd3381d8e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:48.615997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:48.663338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 71/143] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:48.699373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95df63-da7d-4aca-a8c9-982867a8514f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:48.699689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95df63-da7d-4aca-a8c9-982867a8514f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:48.699912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95df63-da7d-4aca-a8c9-982867a8514f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:48.701535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 73/144] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:48.706480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e09c9-e5d6-47b7-87e6-967166dbaf78 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:48.706769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e09c9-e5d6-47b7-87e6-967166dbaf78 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:48.707043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e09c9-e5d6-47b7-87e6-967166dbaf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:48.725573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5d6e09c9-e5d6-47b7-87e6-967166dbaf78 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:48.727298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5d6e09c9-e5d6-47b7-87e6-967166dbaf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:48.775348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85a19e-c720-4adb-89e9-92a04b2d1538 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:48.775670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85a19e-c720-4adb-89e9-92a04b2d1538 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:48.775895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85a19e-c720-4adb-89e9-92a04b2d1538 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:48.777784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 74/145] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:48.783801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959bef9-3a91-4424-bba1-caa03980ca50 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:48.784087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959bef9-3a91-4424-bba1-caa03980ca50 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:48.784364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959bef9-3a91-4424-bba1-caa03980ca50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:48.802251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 72/146] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:48.806429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4959bef9-3a91-4424-bba1-caa03980ca50 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:48.807661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4959bef9-3a91-4424-bba1-caa03980ca50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:48.875452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 75/147] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:48.936779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e09c9-e5d6-47b7-87e6-967166dbaf78 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.027039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:49.040261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e09c9-e5d6-47b7-87e6-967166dbaf78 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.069747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959bef9-3a91-4424-bba1-caa03980ca50 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.075360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620a2fe-a549-4f55-aa33-0ae810484655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.075999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a2fe-a549-4f55-aa33-0ae810484655 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.076283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a2fe-a549-4f55-aa33-0ae810484655 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.076563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a2fe-a549-4f55-aa33-0ae810484655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.088935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620a2fe-a549-4f55-aa33-0ae810484655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-c620a2fe-a549-4f55-aa33-0ae810484655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:49.093995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:49.094867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:49.095833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 73/148] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:49.101911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620a2fe-a549-4f55-aa33-0ae810484655 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.176321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959bef9-3a91-4424-bba1-caa03980ca50 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.201566 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620a2fe-a549-4f55-aa33-0ae810484655 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.204390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:49.210949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c527-3831-4264-a2fb-3aab05976530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.211586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c527-3831-4264-a2fb-3aab05976530 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.211864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c527-3831-4264-a2fb-3aab05976530 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.212133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c527-3831-4264-a2fb-3aab05976530 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.222044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c527-3831-4264-a2fb-3aab05976530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-e629c527-3831-4264-a2fb-3aab05976530 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:49.227511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:49.228545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 76/149] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:46:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:46:49.229776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c527-3831-4264-a2fb-3aab05976530 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.236725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.237326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.237635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.237908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.238588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:49.238890 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.240273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.249531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 74/150] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:49.249531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.260882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:49.332119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c527-3831-4264-a2fb-3aab05976530 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.347232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bbe0-a15b-46d4-8aa0-ba8fe2df5a53 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.365620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cca50-9bee-45c1-8194-b3dd3a88144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.366247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cca50-9bee-45c1-8194-b3dd3a88144c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.366532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cca50-9bee-45c1-8194-b3dd3a88144c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.366799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cca50-9bee-45c1-8194-b3dd3a88144c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.367925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cca50-9bee-45c1-8194-b3dd3a88144c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.369398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cca50-9bee-45c1-8194-b3dd3a88144c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.370983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 77/151] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:49.374334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cca50-9bee-45c1-8194-b3dd3a88144c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.380271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.380865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.381142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.381407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.382109 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:49.382930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.384280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.392213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 75/152] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:46:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:49.393058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.432028 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:49.462518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:49.473598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cca50-9bee-45c1-8194-b3dd3a88144c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.492670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14339d8-890b-4786-8284-5d0f56dbd21f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.507188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6b87f-916e-4201-ac01-57fd79ca2cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.508306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b87f-916e-4201-ac01-57fd79ca2cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.508582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b87f-916e-4201-ac01-57fd79ca2cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.508853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b87f-916e-4201-ac01-57fd79ca2cd2 None admin] PATH_INFO: `/v3/users/dd4be13ea27941db97679cd7b9c697aa` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.522421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6b87f-916e-4201-ac01-57fd79ca2cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4be13ea27941db97679cd7b9c697aa)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.524566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6b87f-916e-4201-ac01-57fd79ca2cd2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.526186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 78/153] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:49 2022] GET /identity/v3/users/dd4be13ea27941db97679cd7b9c697aa => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:49.531018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b357a-6cff-47d7-a80a-99938d50ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.531145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6b87f-916e-4201-ac01-57fd79ca2cd2 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.531239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b357a-6cff-47d7-a80a-99938d50ea36 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.531239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b357a-6cff-47d7-a80a-99938d50ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.531239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b357a-6cff-47d7-a80a-99938d50ea36 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.531239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b357a-6cff-47d7-a80a-99938d50ea36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.531239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b357a-6cff-47d7-a80a-99938d50ea36 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.556803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 76/154] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:46:49 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:49.557646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b357a-6cff-47d7-a80a-99938d50ea36 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.651603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6b87f-916e-4201-ac01-57fd79ca2cd2 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.670006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:49.676892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b357a-6cff-47d7-a80a-99938d50ea36 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.689873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30081a-7c19-4ebb-b1ca-6b21290debd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.690721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30081a-7c19-4ebb-b1ca-6b21290debd3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.690995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30081a-7c19-4ebb-b1ca-6b21290debd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.691262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30081a-7c19-4ebb-b1ca-6b21290debd3 None admin] PATH_INFO: `/v3/users/dd4be13ea27941db97679cd7b9c697aa` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.692421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30081a-7c19-4ebb-b1ca-6b21290debd3 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4be13ea27941db97679cd7b9c697aa)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.694025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30081a-7c19-4ebb-b1ca-6b21290debd3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.701111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 79/155] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:49 2022] GET /identity/v3/users/dd4be13ea27941db97679cd7b9c697aa => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:49.702280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30081a-7c19-4ebb-b1ca-6b21290debd3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.710441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:49.722514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3289ab-ebcf-49ef-9b5f-01cc438c401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.723167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3289ab-ebcf-49ef-9b5f-01cc438c401d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.723449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3289ab-ebcf-49ef-9b5f-01cc438c401d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.723725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3289ab-ebcf-49ef-9b5f-01cc438c401d None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.725262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3289ab-ebcf-49ef-9b5f-01cc438c401d None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.728569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3289ab-ebcf-49ef-9b5f-01cc438c401d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.730440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 77/156] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:49 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:49.737127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3289ab-ebcf-49ef-9b5f-01cc438c401d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.828113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30081a-7c19-4ebb-b1ca-6b21290debd3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.863707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3289ab-ebcf-49ef-9b5f-01cc438c401d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:49.869530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7adf4-ef15-4a40-bbc8-4b008d47fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.870421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7adf4-ef15-4a40-bbc8-4b008d47fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.870910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7adf4-ef15-4a40-bbc8-4b008d47fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.871542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7adf4-ef15-4a40-bbc8-4b008d47fcc9 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.872912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7adf4-ef15-4a40-bbc8-4b008d47fcc9 None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.874652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7adf4-ef15-4a40-bbc8-4b008d47fcc9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.876835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 80/157] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:49 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:49.882403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7adf4-ef15-4a40-bbc8-4b008d47fcc9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:49.906277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d4685-ae54-40a5-af8e-5d661e07c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:49.906940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4685-ae54-40a5-af8e-5d661e07c0d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:49.907214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4685-ae54-40a5-af8e-5d661e07c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:49.907489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d4685-ae54-40a5-af8e-5d661e07c0d2 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/users/dd4be13ea27941db97679cd7b9c697aa/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:49.911718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d4685-ae54-40a5-af8e-5d661e07c0d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a700d82f30b94310b8df3cf9c3ae44c2, user_id=dd4be13ea27941db97679cd7b9c697aa, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:49.912279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d4685-ae54-40a5-af8e-5d661e07c0d2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:49.931381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 78/158] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:49 2022] PUT /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/users/dd4be13ea27941db97679cd7b9c697aa/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:46:49.950389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:50.018313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7adf4-ef15-4a40-bbc8-4b008d47fcc9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:50.059041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0900b-35ae-44ae-a2b8-211a84ed58f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:50.060089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0900b-35ae-44ae-a2b8-211a84ed58f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:50.060578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0900b-35ae-44ae-a2b8-211a84ed58f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:50.061047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0900b-35ae-44ae-a2b8-211a84ed58f0 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/users/dd4be13ea27941db97679cd7b9c697aa/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:50.063719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0900b-35ae-44ae-a2b8-211a84ed58f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a700d82f30b94310b8df3cf9c3ae44c2, user_id=dd4be13ea27941db97679cd7b9c697aa, role_id=7d7ee6a7e93f46e5bff0a079bfb7ea3e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:50.065520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0900b-35ae-44ae-a2b8-211a84ed58f0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:50.084639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 81/159] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:49 2022] PUT /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/users/dd4be13ea27941db97679cd7b9c697aa/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:46:51.869201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6081a5f-3c22-4664-b85f-efb4527b96c4 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:51.870250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6081a5f-3c22-4664-b85f-efb4527b96c4 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:51.870773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6081a5f-3c22-4664-b85f-efb4527b96c4 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:51.872336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 79/160] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:51.877984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d7e2d-aa8f-4f7a-9c3e-7fe597e4a419 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:51.878821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d7e2d-aa8f-4f7a-9c3e-7fe597e4a419 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:51.879293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d7e2d-aa8f-4f7a-9c3e-7fe597e4a419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:51.900035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1d7d7e2d-aa8f-4f7a-9c3e-7fe597e4a419 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:51.901562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1d7d7e2d-aa8f-4f7a-9c3e-7fe597e4a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:51.960986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabcd12-5b65-45a2-b609-c2bfb2631dc6 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:51.961309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabcd12-5b65-45a2-b609-c2bfb2631dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:51.961577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabcd12-5b65-45a2-b609-c2bfb2631dc6 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:51.963341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 80/161] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:51.968283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb8e8-3337-4ce2-a39c-286819e786bc None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:51.968567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb8e8-3337-4ce2-a39c-286819e786bc None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:51.968843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb8e8-3337-4ce2-a39c-286819e786bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:51.981577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 82/162] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:51.992935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-6c5bb8e8-3337-4ce2-a39c-286819e786bc None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:51.994160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6c5bb8e8-3337-4ce2-a39c-286819e786bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:52.047116 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:52.067240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 81/163] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:52.170131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15330-cbcc-439d-8966-3c108a0e1775 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.170823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15330-cbcc-439d-8966-3c108a0e1775 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.171295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef15330-cbcc-439d-8966-3c108a0e1775 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.173102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 83/164] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:52.178155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7305aba-7259-4319-bdf6-1ffad25e0831 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.178644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7305aba-7259-4319-bdf6-1ffad25e0831 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.179156 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7305aba-7259-4319-bdf6-1ffad25e0831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.197402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c7305aba-7259-4319-bdf6-1ffad25e0831 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:52.198884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c7305aba-7259-4319-bdf6-1ffad25e0831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:52.237364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0098f-560e-4f00-ae71-302d4f043518 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.237979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0098f-560e-4f00-ae71-302d4f043518 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.238542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0098f-560e-4f00-ae71-302d4f043518 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.240060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 84/165] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:52.248238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d4c4-2bb1-4f06-a645-2dd0f1180cf3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.248238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d4c4-2bb1-4f06-a645-2dd0f1180cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.248238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d4c4-2bb1-4f06-a645-2dd0f1180cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.264397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0485d4c4-2bb1-4f06-a645-2dd0f1180cf3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:52.265982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0485d4c4-2bb1-4f06-a645-2dd0f1180cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:52.271018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 82/166] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:52.279816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7305aba-7259-4319-bdf6-1ffad25e0831 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:52.312870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:52.353506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 85/167] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:52.353506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d4c4-2bb1-4f06-a645-2dd0f1180cf3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:52.395851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7305aba-7259-4319-bdf6-1ffad25e0831 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:52.420322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:52.449900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c179e-066d-40d5-9993-eaf3c2f59ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:52.450588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c179e-066d-40d5-9993-eaf3c2f59ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.450971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c179e-066d-40d5-9993-eaf3c2f59ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.451250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c179e-066d-40d5-9993-eaf3c2f59ee0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.463396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c179e-066d-40d5-9993-eaf3c2f59ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-1a6c179e-066d-40d5-9993-eaf3c2f59ee0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:52.469663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:52.470543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:52.471343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:52.471956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 83/168] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:46:52.472813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d4c4-2bb1-4f06-a645-2dd0f1180cf3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:52.480379 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c179e-066d-40d5-9993-eaf3c2f59ee0 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:52.510396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea59b-720c-4923-8de7-05f77449a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:52.511305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea59b-720c-4923-8de7-05f77449a091 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.511641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea59b-720c-4923-8de7-05f77449a091 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.511917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea59b-720c-4923-8de7-05f77449a091 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.513239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aea59b-720c-4923-8de7-05f77449a091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:52.515617 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aea59b-720c-4923-8de7-05f77449a091 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:52.517437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 86/169] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:52.524390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea59b-720c-4923-8de7-05f77449a091 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:52.573641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:52.595070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c179e-066d-40d5-9993-eaf3c2f59ee0 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:52.636467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:52.637137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.637416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.637581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea59b-720c-4923-8de7-05f77449a091 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:52.637722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.638401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:52.638709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:52.640111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:52.648380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 84/170] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:52.649014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:52.673839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef14c5-7711-4106-a78d-935e6b5dec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:52.674370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef14c5-7711-4106-a78d-935e6b5dec32 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.674647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef14c5-7711-4106-a78d-935e6b5dec32 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.674915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef14c5-7711-4106-a78d-935e6b5dec32 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.675560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef14c5-7711-4106-a78d-935e6b5dec32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:52.676993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef14c5-7711-4106-a78d-935e6b5dec32 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:52.688569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:52.699387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 87/171] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:46:52 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:46:52.706929 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef14c5-7711-4106-a78d-935e6b5dec32 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:52.758697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d4a9-a640-4e55-843a-4bb489a883cf None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:52.798132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef614c-6e10-488d-8e50-7ce177631426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:52.799201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef614c-6e10-488d-8e50-7ce177631426 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.799743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef614c-6e10-488d-8e50-7ce177631426 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.800167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef614c-6e10-488d-8e50-7ce177631426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.809744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:52.814229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef614c-6e10-488d-8e50-7ce177631426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:52.817366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef14c5-7711-4106-a78d-935e6b5dec32 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-8fef614c-6e10-488d-8e50-7ce177631426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:52.819267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:52.820300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 85/172] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:52.824405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef614c-6e10-488d-8e50-7ce177631426 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:52.862168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4889b-bd15-4e8b-8efa-d4b5717da90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:52.862840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4889b-bd15-4e8b-8efa-d4b5717da90a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.863124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4889b-bd15-4e8b-8efa-d4b5717da90a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.863394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4889b-bd15-4e8b-8efa-d4b5717da90a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:52.876657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4889b-bd15-4e8b-8efa-d4b5717da90a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-33c4889b-bd15-4e8b-8efa-d4b5717da90a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:52.883209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:52.884521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 88/173] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:46:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:52.885305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4889b-bd15-4e8b-8efa-d4b5717da90a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:52.939587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:52.945312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef614c-6e10-488d-8e50-7ce177631426 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:52.990784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df80a4-a8f6-4f79-bffc-4a44e3bb4ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:52.992312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df80a4-a8f6-4f79-bffc-4a44e3bb4ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:52.992604 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df80a4-a8f6-4f79-bffc-4a44e3bb4ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:52.993167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df80a4-a8f6-4f79-bffc-4a44e3bb4ed7 None admin] PATH_INFO: `/v3/users/b2522149e84242d2b8f70fa018b948df` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.013470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df80a4-a8f6-4f79-bffc-4a44e3bb4ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=b2522149e84242d2b8f70fa018b948df)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.015006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df80a4-a8f6-4f79-bffc-4a44e3bb4ed7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:53.016705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 86/174] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:52 2022] GET /identity/v3/users/b2522149e84242d2b8f70fa018b948df => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:53.017475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df80a4-a8f6-4f79-bffc-4a44e3bb4ed7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:53.023517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4889b-bd15-4e8b-8efa-d4b5717da90a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:53.063371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:53.064095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.064398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.064650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.065325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:53.065662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.067047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:53.077582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 89/175] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:53.078859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:53.103060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:53.148461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df80a4-a8f6-4f79-bffc-4a44e3bb4ed7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:53.192543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8685-4df7-4d57-8950-847ff1b89358 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:53.194387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:53.195184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.195469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.195734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.196826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:53.196826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.198090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:53.206399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 87/176] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:46:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:53.207121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:53.231391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b54296-fde8-42fe-b56a-5c89d8b5071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:53.232164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:53.232735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b54296-fde8-42fe-b56a-5c89d8b5071a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.233229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b54296-fde8-42fe-b56a-5c89d8b5071a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.233734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b54296-fde8-42fe-b56a-5c89d8b5071a None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.236288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b54296-fde8-42fe-b56a-5c89d8b5071a None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.237376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b54296-fde8-42fe-b56a-5c89d8b5071a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:53.239766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 90/177] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:53 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:53.240876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b54296-fde8-42fe-b56a-5c89d8b5071a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:53.340783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36600c-a34a-4e6f-ab45-9d965a019064 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:53.350647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:53.367491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b54296-fde8-42fe-b56a-5c89d8b5071a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:53.385724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe33d8-2a94-4dfb-8ede-6e0f6a748210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:53.386389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe33d8-2a94-4dfb-8ede-6e0f6a748210 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.386661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe33d8-2a94-4dfb-8ede-6e0f6a748210 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.386927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe33d8-2a94-4dfb-8ede-6e0f6a748210 None admin] PATH_INFO: `/v3/users/dd4be13ea27941db97679cd7b9c697aa` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.388450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe33d8-2a94-4dfb-8ede-6e0f6a748210 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4be13ea27941db97679cd7b9c697aa)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.389937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe33d8-2a94-4dfb-8ede-6e0f6a748210 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:53.392069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 88/178] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:53 2022] GET /identity/v3/users/dd4be13ea27941db97679cd7b9c697aa => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:53.393147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe33d8-2a94-4dfb-8ede-6e0f6a748210 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:53.407470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157c763-d966-4a25-bab3-e39816cd7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:53.408440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157c763-d966-4a25-bab3-e39816cd7c53 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.408939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157c763-d966-4a25-bab3-e39816cd7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.409411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157c763-d966-4a25-bab3-e39816cd7c53 None admin] PATH_INFO: `/v3/users/dd4be13ea27941db97679cd7b9c697aa` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.410791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157c763-d966-4a25-bab3-e39816cd7c53 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4be13ea27941db97679cd7b9c697aa)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.412600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157c763-d966-4a25-bab3-e39816cd7c53 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:53.414533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 91/179] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:53 2022] GET /identity/v3/users/dd4be13ea27941db97679cd7b9c697aa => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:53.415670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157c763-d966-4a25-bab3-e39816cd7c53 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:53.493830 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:53.513895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe33d8-2a94-4dfb-8ede-6e0f6a748210 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:53.527354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157c763-d966-4a25-bab3-e39816cd7c53 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:53.555988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf32e4-8e14-4edc-85e0-e8d82aad9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:53.557006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf32e4-8e14-4edc-85e0-e8d82aad9239 None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.557392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf32e4-8e14-4edc-85e0-e8d82aad9239 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.557811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf32e4-8e14-4edc-85e0-e8d82aad9239 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/users/b2522149e84242d2b8f70fa018b948df/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.559833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf32e4-8e14-4edc-85e0-e8d82aad9239 None admin] RBAC: Authorizing `identity:create_grant(project_id=a700d82f30b94310b8df3cf9c3ae44c2, user_id=b2522149e84242d2b8f70fa018b948df, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.561382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf32e4-8e14-4edc-85e0-e8d82aad9239 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:53.563374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ab1f4-4e6e-413f-998f-168733562d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:53.564307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ab1f4-4e6e-413f-998f-168733562d9d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.565109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ab1f4-4e6e-413f-998f-168733562d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.565663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ab1f4-4e6e-413f-998f-168733562d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.578324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 89/180] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:53 2022] PUT /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/users/b2522149e84242d2b8f70fa018b948df/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:46:53.585833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf32e4-8e14-4edc-85e0-e8d82aad9239 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:53.620682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:53.751868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf32e4-8e14-4edc-85e0-e8d82aad9239 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:53.758708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ab1f4-4e6e-413f-998f-168733562d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.760636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ab1f4-4e6e-413f-998f-168733562d9d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:53.795078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192fc00-0915-4806-ad96-93273fca6031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:53.796117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192fc00-0915-4806-ad96-93273fca6031 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.796400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192fc00-0915-4806-ad96-93273fca6031 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.796950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192fc00-0915-4806-ad96-93273fca6031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.814634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:53.875610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 92/181] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:46:53.881220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ab1f4-4e6e-413f-998f-168733562d9d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:53.882791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192fc00-0915-4806-ad96-93273fca6031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:53.884597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192fc00-0915-4806-ad96-93273fca6031 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:54.000165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 90/182] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:46:54.006392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192fc00-0915-4806-ad96-93273fca6031 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:54.014942 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:54.070048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:54.122295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ab1f4-4e6e-413f-998f-168733562d9d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:54.126960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192fc00-0915-4806-ad96-93273fca6031 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:54.161994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0243b28-fb51-49e1-bcb3-15327ef37cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:54.162774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243b28-fb51-49e1-bcb3-15327ef37cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:54.163188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243b28-fb51-49e1-bcb3-15327ef37cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:54.164118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243b28-fb51-49e1-bcb3-15327ef37cb3 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:54.165374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0243b28-fb51-49e1-bcb3-15327ef37cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:54.166936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0243b28-fb51-49e1-bcb3-15327ef37cb3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:54.173193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 91/183] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:54 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:54.177925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0243b28-fb51-49e1-bcb3-15327ef37cb3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:54.199033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b459783-7597-4253-93f5-c45478e32bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:54.199984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459783-7597-4253-93f5-c45478e32bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:54.200543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459783-7597-4253-93f5-c45478e32bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:54.201024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459783-7597-4253-93f5-c45478e32bc4 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:54.202370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b459783-7597-4253-93f5-c45478e32bc4 None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:54.204010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b459783-7597-4253-93f5-c45478e32bc4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:54.205875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 93/184] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:53 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:54.212171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b459783-7597-4253-93f5-c45478e32bc4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:54.287983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0243b28-fb51-49e1-bcb3-15327ef37cb3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:54.317839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:54.323876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd574d9-f4ce-44ce-8bc8-c288de5d1c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:54.324493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd574d9-f4ce-44ce-8bc8-c288de5d1c48 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:54.324771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd574d9-f4ce-44ce-8bc8-c288de5d1c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:54.325041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd574d9-f4ce-44ce-8bc8-c288de5d1c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:54.325826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd574d9-f4ce-44ce-8bc8-c288de5d1c48 None admin] RBAC: Adding query filter params (role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e, scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2, user.id=dd4be13ea27941db97679cd7b9c697aa) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:54.326136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd574d9-f4ce-44ce-8bc8-c288de5d1c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:54.327718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd574d9-f4ce-44ce-8bc8-c288de5d1c48 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:54.334431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 92/185] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:46:54 2022] GET /identity/v3/role_assignments?user.id=dd4be13ea27941db97679cd7b9c697aa&scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2&role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:54.454918 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b459783-7597-4253-93f5-c45478e32bc4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:54.492791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:54.511281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a848267-d2d5-4107-964b-2aa2b31e93d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:54.511481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a848267-d2d5-4107-964b-2aa2b31e93d2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:54.511728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a848267-d2d5-4107-964b-2aa2b31e93d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:54.512023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a848267-d2d5-4107-964b-2aa2b31e93d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:54.512754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a848267-d2d5-4107-964b-2aa2b31e93d2 None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2, user.id=dd4be13ea27941db97679cd7b9c697aa) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:54.513058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a848267-d2d5-4107-964b-2aa2b31e93d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:54.514544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a848267-d2d5-4107-964b-2aa2b31e93d2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:54.535633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 94/186] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:46:54 2022] GET /identity/v3/role_assignments?user.id=dd4be13ea27941db97679cd7b9c697aa&scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:55.066919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c072c-cc30-4487-bff7-5fde693f310f None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.067419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c072c-cc30-4487-bff7-5fde693f310f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.067520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c072c-cc30-4487-bff7-5fde693f310f None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.068792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 93/187] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:55.074535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5584-aba3-4081-9258-49c2f6426718 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.074928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5584-aba3-4081-9258-49c2f6426718 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.075080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5584-aba3-4081-9258-49c2f6426718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.093695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-295e5584-aba3-4081-9258-49c2f6426718 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:55.094887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-295e5584-aba3-4081-9258-49c2f6426718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:55.163452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 95/188] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:55.342658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cdae5-b010-499a-89d0-07630ee801ee None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.342942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cdae5-b010-499a-89d0-07630ee801ee None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.343381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cdae5-b010-499a-89d0-07630ee801ee None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.344870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 94/189] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:55.350045 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8dd0-1d90-4772-8dc2-23e483795e9d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.350335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8dd0-1d90-4772-8dc2-23e483795e9d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.350611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8dd0-1d90-4772-8dc2-23e483795e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.370337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-53fc8dd0-1d90-4772-8dc2-23e483795e9d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:55.371504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-53fc8dd0-1d90-4772-8dc2-23e483795e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:55.429060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cdae5-b010-499a-89d0-07630ee801ee None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:55.440155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 96/190] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:55.531161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cdae5-b010-499a-89d0-07630ee801ee None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:55.566281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbc15d-0d2c-47ac-8669-a96cc88767de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:55.566970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc15d-0d2c-47ac-8669-a96cc88767de None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.567278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc15d-0d2c-47ac-8669-a96cc88767de None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.567548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc15d-0d2c-47ac-8669-a96cc88767de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.577822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbc15d-0d2c-47ac-8669-a96cc88767de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-a8fbc15d-0d2c-47ac-8669-a96cc88767de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:55.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:55.583617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:46:55.584420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:55.588832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 95/191] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:46:55.589675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8dd0-1d90-4772-8dc2-23e483795e9d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:55.639505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:55.693718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8dd0-1d90-4772-8dc2-23e483795e9d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:55.722654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbc15d-0d2c-47ac-8669-a96cc88767de None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:55.728850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:55.729459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.729781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.730051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.730718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:55.731018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:55.732393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:55.741816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 97/192] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:55.747026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:55.764621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:55.833659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbc15d-0d2c-47ac-8669-a96cc88767de None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:55.850405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbaa87-b22d-4535-a674-d3e4c8a537f0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:55.860245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:55.872321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588aa3-31e1-4dbd-ad81-79b6a33eb243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:55.872948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588aa3-31e1-4dbd-ad81-79b6a33eb243 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.873222 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588aa3-31e1-4dbd-ad81-79b6a33eb243 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.873517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1588aa3-31e1-4dbd-ad81-79b6a33eb243 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.874621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1588aa3-31e1-4dbd-ad81-79b6a33eb243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:55.876074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1588aa3-31e1-4dbd-ad81-79b6a33eb243 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:55.877673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 96/193] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:55.883038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588aa3-31e1-4dbd-ad81-79b6a33eb243 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:55.889283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644df85-7d54-4747-b4e7-e6fce2083636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:55.890239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644df85-7d54-4747-b4e7-e6fce2083636 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.890699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644df85-7d54-4747-b4e7-e6fce2083636 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.891179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644df85-7d54-4747-b4e7-e6fce2083636 None admin] PATH_INFO: `/v3/users/2771f74a89014dd5a3223ffab6b33baa` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.906131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644df85-7d54-4747-b4e7-e6fce2083636 None admin] RBAC: Authorizing `identity:get_user(user_id=2771f74a89014dd5a3223ffab6b33baa)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:55.907610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644df85-7d54-4747-b4e7-e6fce2083636 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:55.909261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 98/194] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:55 2022] GET /identity/v3/users/2771f74a89014dd5a3223ffab6b33baa => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:55.915156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644df85-7d54-4747-b4e7-e6fce2083636 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:56.001750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1588aa3-31e1-4dbd-ad81-79b6a33eb243 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:56.009112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:56.032050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644df85-7d54-4747-b4e7-e6fce2083636 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:56.037341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63805706-dcdc-4e96-b69b-b6a319149afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:56.037983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63805706-dcdc-4e96-b69b-b6a319149afe None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:56.038362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63805706-dcdc-4e96-b69b-b6a319149afe None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:56.038639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63805706-dcdc-4e96-b69b-b6a319149afe None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:56.039323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63805706-dcdc-4e96-b69b-b6a319149afe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:56.040764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63805706-dcdc-4e96-b69b-b6a319149afe None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:56.063145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 97/195] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:46:55 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:46:56.073736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb31b1d-fadd-44e1-9150-b75bb2f01c46 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:56.073736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb31b1d-fadd-44e1-9150-b75bb2f01c46 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:56.073736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb31b1d-fadd-44e1-9150-b75bb2f01c46 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:56.073736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 98/196] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:56.074429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b349f4-41cb-433c-b7dc-9ce4b2d0af08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:56.074429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b349f4-41cb-433c-b7dc-9ce4b2d0af08 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:56.074429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b349f4-41cb-433c-b7dc-9ce4b2d0af08 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:56.074429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b349f4-41cb-433c-b7dc-9ce4b2d0af08 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:56.075114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b349f4-41cb-433c-b7dc-9ce4b2d0af08 None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:56.075182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf76-2971-4596-9608-3804961df57d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:56.075182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf76-2971-4596-9608-3804961df57d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:56.075182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf76-2971-4596-9608-3804961df57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:56.075364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b349f4-41cb-433c-b7dc-9ce4b2d0af08 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:56.075364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 99/197] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:55 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:56.081157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b349f4-41cb-433c-b7dc-9ce4b2d0af08 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:56.092594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8d0bcf76-2971-4596-9608-3804961df57d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:56.093862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8d0bcf76-2971-4596-9608-3804961df57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:56.129225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:56.173569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 99/198] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:56.209177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b349f4-41cb-433c-b7dc-9ce4b2d0af08 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:56.248439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2d3a3-de46-43d7-b95b-7a79e0c2f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:56.249103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d3a3-de46-43d7-b95b-7a79e0c2f870 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:56.249381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d3a3-de46-43d7-b95b-7a79e0c2f870 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:56.249673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d3a3-de46-43d7-b95b-7a79e0c2f870 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/users/2771f74a89014dd5a3223ffab6b33baa/roles/d7cac0839e014250a46eec827e0e2256` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:56.251571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2d3a3-de46-43d7-b95b-7a79e0c2f870 None admin] RBAC: Authorizing `identity:create_grant(project_id=a700d82f30b94310b8df3cf9c3ae44c2, user_id=2771f74a89014dd5a3223ffab6b33baa, role_id=d7cac0839e014250a46eec827e0e2256)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:56.253020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2d3a3-de46-43d7-b95b-7a79e0c2f870 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:56.266954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 100/199] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:46:56 2022] PUT /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/users/2771f74a89014dd5a3223ffab6b33baa/roles/d7cac0839e014250a46eec827e0e2256 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:46:56.442525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bcf76-2971-4596-9608-3804961df57d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:56.541528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:56.551429 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bcf76-2971-4596-9608-3804961df57d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:56.586914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38626e9a-9c1b-4854-bc07-72d3277502fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:56.587544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38626e9a-9c1b-4854-bc07-72d3277502fb None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:56.587815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38626e9a-9c1b-4854-bc07-72d3277502fb None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:56.588080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38626e9a-9c1b-4854-bc07-72d3277502fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:56.598895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38626e9a-9c1b-4854-bc07-72d3277502fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-38626e9a-9c1b-4854-bc07-72d3277502fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:56.604369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:56.605258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:56.606474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 100/200] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:56.614565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2d3a3-de46-43d7-b95b-7a79e0c2f870 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:56.712200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:56.720526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2d3a3-de46-43d7-b95b-7a79e0c2f870 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:56.758165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:56.758781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:56.759052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:56.759371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:56.760037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:56.760337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:56.761806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:56.770878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 101/201] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:56.777072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38626e9a-9c1b-4854-bc07-72d3277502fb None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:56.884908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38626e9a-9c1b-4854-bc07-72d3277502fb None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:56.920551 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b98f-44f9-43ce-8bc9-33e00314aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:56.921179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b98f-44f9-43ce-8bc9-33e00314aa25 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:56.921519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b98f-44f9-43ce-8bc9-33e00314aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:56.921798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b98f-44f9-43ce-8bc9-33e00314aa25 None admin] PATH_INFO: `/v3/users/b2522149e84242d2b8f70fa018b948df` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:56.922937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009b98f-44f9-43ce-8bc9-33e00314aa25 None admin] RBAC: Authorizing `identity:get_user(user_id=b2522149e84242d2b8f70fa018b948df)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:56.924384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009b98f-44f9-43ce-8bc9-33e00314aa25 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:56.926290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 101/202] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:56 2022] GET /identity/v3/users/b2522149e84242d2b8f70fa018b948df => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:56.934772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:57.043117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c3c07-89ec-487b-90d5-4fdc2f14aaf3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:57.079176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34459681-fb35-4cee-aac7-e0d02664884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:57.080583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34459681-fb35-4cee-aac7-e0d02664884c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:57.081078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34459681-fb35-4cee-aac7-e0d02664884c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:57.081577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34459681-fb35-4cee-aac7-e0d02664884c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:57.112697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:57.160696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34459681-fb35-4cee-aac7-e0d02664884c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:57.162211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34459681-fb35-4cee-aac7-e0d02664884c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:57.268885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 102/203] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:46:57.274803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b98f-44f9-43ce-8bc9-33e00314aa25 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:57.299891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:57.383297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b98f-44f9-43ce-8bc9-33e00314aa25 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:57.417582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4120da1-1a2a-4595-88f6-32a7e9361440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:57.418501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4120da1-1a2a-4595-88f6-32a7e9361440 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:57.418974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4120da1-1a2a-4595-88f6-32a7e9361440 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:57.419440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4120da1-1a2a-4595-88f6-32a7e9361440 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:57.420784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4120da1-1a2a-4595-88f6-32a7e9361440 None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:57.422432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4120da1-1a2a-4595-88f6-32a7e9361440 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:57.424291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 102/204] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:57 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:57.434535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34459681-fb35-4cee-aac7-e0d02664884c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:57.493265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:57.538259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34459681-fb35-4cee-aac7-e0d02664884c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:57.574459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41b672-7101-483a-a1e9-31372f1d1dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:57.575079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b672-7101-483a-a1e9-31372f1d1dbe None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:57.575360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b672-7101-483a-a1e9-31372f1d1dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:57.575635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b672-7101-483a-a1e9-31372f1d1dbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:57.576376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b672-7101-483a-a1e9-31372f1d1dbe None admin] RBAC: Adding query filter params (role.id=a754d895803642e894fc6ccc699d51d9, scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2, user.id=b2522149e84242d2b8f70fa018b948df) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:57.576688 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b672-7101-483a-a1e9-31372f1d1dbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:57.578226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b672-7101-483a-a1e9-31372f1d1dbe None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:57.584526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 103/205] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:46:57 2022] GET /identity/v3/role_assignments?user.id=b2522149e84242d2b8f70fa018b948df&scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2&role.id=a754d895803642e894fc6ccc699d51d9 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:58.456608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f039-1cd1-4fa1-9aac-843db5c99ff6 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:58.457122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f039-1cd1-4fa1-9aac-843db5c99ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:58.457122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f039-1cd1-4fa1-9aac-843db5c99ff6 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:58.458775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 103/206] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:58.464858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498876-9718-4f78-907b-f9d493162ada None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:58.465341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498876-9718-4f78-907b-f9d493162ada None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:58.465412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1498876-9718-4f78-907b-f9d493162ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:58.483294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d1498876-9718-4f78-907b-f9d493162ada None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:58.484720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d1498876-9718-4f78-907b-f9d493162ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:58.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310403d-1c78-4815-af11-a2dafb56623d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:58.500339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310403d-1c78-4815-af11-a2dafb56623d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:58.500603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310403d-1c78-4815-af11-a2dafb56623d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:58.501966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 104/207] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:58.507736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216568f-12ef-495b-bbce-573fc67c399c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:58.508009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216568f-12ef-495b-bbce-573fc67c399c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:58.508276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216568f-12ef-495b-bbce-573fc67c399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:58.528440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-e216568f-12ef-495b-bbce-573fc67c399c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:58.529670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e216568f-12ef-495b-bbce-573fc67c399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:58.568953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 104/208] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:58.570930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acca18-1dea-4c36-a802-6498e581bb96 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:58.571277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acca18-1dea-4c36-a802-6498e581bb96 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:58.572011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acca18-1dea-4c36-a802-6498e581bb96 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:58.573347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 105/209] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:58.578665 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f512a06-0b12-4f3a-b6fb-396def1c8828 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:58.578944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f512a06-0b12-4f3a-b6fb-396def1c8828 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:58.579211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f512a06-0b12-4f3a-b6fb-396def1c8828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:58.598196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0f512a06-0b12-4f3a-b6fb-396def1c8828 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:58.598851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 105/210] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:46:58.599379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0f512a06-0b12-4f3a-b6fb-396def1c8828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:58.648077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:58.669568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 106/211] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:46:58.833415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216568f-12ef-495b-bbce-573fc67c399c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:58.852912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:58.864684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f512a06-0b12-4f3a-b6fb-396def1c8828 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:58.935564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216568f-12ef-495b-bbce-573fc67c399c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:58.967258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f512a06-0b12-4f3a-b6fb-396def1c8828 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:58.970536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1358e-5df1-4d24-a6d1-315ccd042a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:58.971163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1358e-5df1-4d24-a6d1-315ccd042a9d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:58.971440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1358e-5df1-4d24-a6d1-315ccd042a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:58.971710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1358e-5df1-4d24-a6d1-315ccd042a9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:58.982517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1358e-5df1-4d24-a6d1-315ccd042a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-37f1358e-5df1-4d24-a6d1-315ccd042a9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:58.987939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:58.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 106/212] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:58.994928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1358e-5df1-4d24-a6d1-315ccd042a9d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.002212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64340075-133a-4149-9cb1-d91d9d42adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.002843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64340075-133a-4149-9cb1-d91d9d42adaa None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.003116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64340075-133a-4149-9cb1-d91d9d42adaa None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.003385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64340075-133a-4149-9cb1-d91d9d42adaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.004466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64340075-133a-4149-9cb1-d91d9d42adaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:59.006008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64340075-133a-4149-9cb1-d91d9d42adaa None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:59.010753 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 107/213] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:59.010753 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64340075-133a-4149-9cb1-d91d9d42adaa None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.055702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:59.074484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:59.096979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1358e-5df1-4d24-a6d1-315ccd042a9d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:59.105030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64340075-133a-4149-9cb1-d91d9d42adaa None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:59.130525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8db22-d983-427f-880b-b129f3d5d5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.131147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8db22-d983-427f-880b-b129f3d5d5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.131423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8db22-d983-427f-880b-b129f3d5d5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.131693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8db22-d983-427f-880b-b129f3d5d5c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.137717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.138321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.138599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.138868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.139525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:59.139826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:59.141193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:59.142105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8db22-d983-427f-880b-b129f3d5d5c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-7cf8db22-d983-427f-880b-b129f3d5d5c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:46:59.146929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:46:59.148330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:46:59.149119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 107/214] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:46:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:46:59.150444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 108/215] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:59.150521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8db22-d983-427f-880b-b129f3d5d5c0 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.154553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.247451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8db22-d983-427f-880b-b129f3d5d5c0 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:59.251022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871b803-1538-4501-b804-84c462fd46a5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:59.261415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:59.280327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e8c44-f846-4cb5-a68e-086f637cfc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.280921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e8c44-f846-4cb5-a68e-086f637cfc38 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.281199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e8c44-f846-4cb5-a68e-086f637cfc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.281472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e8c44-f846-4cb5-a68e-086f637cfc38 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.282144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e8c44-f846-4cb5-a68e-086f637cfc38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:59.283644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e8c44-f846-4cb5-a68e-086f637cfc38 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:59.284473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.285067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.285341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.285645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.286301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:59.286601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:59.287936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:59.293825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:59.296397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 109/216] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:46:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:59.301509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.318047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 108/217] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:46:59 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:46:59.318047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e8c44-f846-4cb5-a68e-086f637cfc38 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.419851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60596-29e7-44b1-a6e4-3753478c98c3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:59.427294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e8c44-f846-4cb5-a68e-086f637cfc38 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:59.456391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548901ff-99a8-433d-a8bd-b63989f758e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.457395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548901ff-99a8-433d-a8bd-b63989f758e0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.457849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548901ff-99a8-433d-a8bd-b63989f758e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.458124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548901ff-99a8-433d-a8bd-b63989f758e0 None admin] PATH_INFO: `/v3/users/4720048c990348f983a89d9fa34af3b0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.465095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cafb6-40a4-4aa8-a3cd-d154220b9291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.465775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cafb6-40a4-4aa8-a3cd-d154220b9291 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.466048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cafb6-40a4-4aa8-a3cd-d154220b9291 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.466320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cafb6-40a4-4aa8-a3cd-d154220b9291 None admin] PATH_INFO: `/v3/users/2771f74a89014dd5a3223ffab6b33baa` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.467574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cafb6-40a4-4aa8-a3cd-d154220b9291 None admin] RBAC: Authorizing `identity:get_user(user_id=2771f74a89014dd5a3223ffab6b33baa)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:59.469072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cafb6-40a4-4aa8-a3cd-d154220b9291 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:59.470888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 109/218] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:59 2022] GET /identity/v3/users/2771f74a89014dd5a3223ffab6b33baa => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:59.474119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548901ff-99a8-433d-a8bd-b63989f758e0 None admin] RBAC: Authorizing `identity:get_user(user_id=4720048c990348f983a89d9fa34af3b0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:59.475743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548901ff-99a8-433d-a8bd-b63989f758e0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:59.476252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cafb6-40a4-4aa8-a3cd-d154220b9291 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.477513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 110/219] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:46:59 2022] GET /identity/v3/users/4720048c990348f983a89d9fa34af3b0 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:59.482997 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548901ff-99a8-433d-a8bd-b63989f758e0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.517870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:59.545170 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:59.596606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cafb6-40a4-4aa8-a3cd-d154220b9291 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:59.608377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548901ff-99a8-433d-a8bd-b63989f758e0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:59.646308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38233b0-d13e-4326-a11a-f568457def20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.646522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38233b0-d13e-4326-a11a-f568457def20 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.646804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38233b0-d13e-4326-a11a-f568457def20 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.647073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38233b0-d13e-4326-a11a-f568457def20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.655058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:59.655058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:59.655058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:59.655058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:59.655553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] RBAC: Adding query filter params (role.id=a754d895803642e894fc6ccc699d51d9, user.id=4720048c990348f983a89d9fa34af3b0, scope.system=all) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:46:59.656503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:59.658852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:59.664813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 111/220] 10.222.0.47 () {56 vars in 1308 bytes} [Fri Oct 14 12:46:59 2022] GET /identity/v3/role_assignments?user.id=4720048c990348f983a89d9fa34af3b0&scope.system=all&role.id=a754d895803642e894fc6ccc699d51d9 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:59.728080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38233b0-d13e-4326-a11a-f568457def20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:59.729506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38233b0-d13e-4326-a11a-f568457def20 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:59.800949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:59.846507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 110/221] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 12:46:59.852124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:59.959660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:46:59.966352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06b4e-b2d9-438d-a338-425cbfce88b5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:00.003562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd0815-ba92-4544-9241-e02a113e50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:00.004189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0815-ba92-4544-9241-e02a113e50e9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.004462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0815-ba92-4544-9241-e02a113e50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.004726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd0815-ba92-4544-9241-e02a113e50e9 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.005867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd0815-ba92-4544-9241-e02a113e50e9 None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:00.007884 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd0815-ba92-4544-9241-e02a113e50e9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:00.009716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 112/222] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:46:59 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:00.015364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38233b0-d13e-4326-a11a-f568457def20 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:00.114923 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38233b0-d13e-4326-a11a-f568457def20 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:00.149713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb444ff-146a-4667-9faa-3a8c555b27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:00.150319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb444ff-146a-4667-9faa-3a8c555b27b7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.150595 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb444ff-146a-4667-9faa-3a8c555b27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.150861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb444ff-146a-4667-9faa-3a8c555b27b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.151582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb444ff-146a-4667-9faa-3a8c555b27b7 None admin] RBAC: Adding query filter params (role.id=d7cac0839e014250a46eec827e0e2256, scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2, user.id=2771f74a89014dd5a3223ffab6b33baa) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:00.151885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb444ff-146a-4667-9faa-3a8c555b27b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:00.153311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb444ff-146a-4667-9faa-3a8c555b27b7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:00.159577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 111/223] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:00 2022] GET /identity/v3/role_assignments?user.id=2771f74a89014dd5a3223ffab6b33baa&scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2&role.id=d7cac0839e014250a46eec827e0e2256 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:01.609779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456b3df-6867-422e-895e-f75a85a056d8 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.610291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456b3df-6867-422e-895e-f75a85a056d8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.610291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456b3df-6867-422e-895e-f75a85a056d8 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.611698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 113/224] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:01.616788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb100-fde3-41e1-b9b2-2788ecc5fb0d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.617179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb100-fde3-41e1-b9b2-2788ecc5fb0d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.617335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb100-fde3-41e1-b9b2-2788ecc5fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.636303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-332cb100-fde3-41e1-b9b2-2788ecc5fb0d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:01.637476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-332cb100-fde3-41e1-b9b2-2788ecc5fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:01.653428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915e16-2a4b-4d1a-9b88-215b9410d6fd None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.653739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915e16-2a4b-4d1a-9b88-215b9410d6fd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.654009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915e16-2a4b-4d1a-9b88-215b9410d6fd None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.655360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 114/225] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:01.660319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df318a92-8969-401a-b559-a0e326ecb5b1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.660605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df318a92-8969-401a-b559-a0e326ecb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.660881 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df318a92-8969-401a-b559-a0e326ecb5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.662123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:01.679915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-df318a92-8969-401a-b559-a0e326ecb5b1 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:01.681092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-df318a92-8969-401a-b559-a0e326ecb5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:01.721555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 112/226] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:01.755703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 115/227] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:01.912784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575966e-9767-4884-9396-0e160f9fc854 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.913653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575966e-9767-4884-9396-0e160f9fc854 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.913828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575966e-9767-4884-9396-0e160f9fc854 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.915311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 113/228] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:01.920374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ddf4-a783-4f96-9a23-7a13f09cda85 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.920660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ddf4-a783-4f96-9a23-7a13f09cda85 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.921046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ddf4-a783-4f96-9a23-7a13f09cda85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.939033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b317ddf4-a783-4f96-9a23-7a13f09cda85 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:01.940220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b317ddf4-a783-4f96-9a23-7a13f09cda85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:01.987910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575966e-9767-4884-9396-0e160f9fc854 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.009723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 116/229] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:02.023408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317ddf4-a783-4f96-9a23-7a13f09cda85 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.047434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:02.111733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575966e-9767-4884-9396-0e160f9fc854 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.124221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317ddf4-a783-4f96-9a23-7a13f09cda85 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.150689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e479fdd-f898-4d67-ab4d-ef01ae0cb913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.151701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e479fdd-f898-4d67-ab4d-ef01ae0cb913 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.152153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e479fdd-f898-4d67-ab4d-ef01ae0cb913 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.152483 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e479fdd-f898-4d67-ab4d-ef01ae0cb913 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.159292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9cd0a-d5ca-46c7-9726-c93b053741d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.159930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cd0a-d5ca-46c7-9726-c93b053741d8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.160211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cd0a-d5ca-46c7-9726-c93b053741d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.160482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cd0a-d5ca-46c7-9726-c93b053741d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.161619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9cd0a-d5ca-46c7-9726-c93b053741d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:02.163658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9cd0a-d5ca-46c7-9726-c93b053741d8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:02.164633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e479fdd-f898-4d67-ab4d-ef01ae0cb913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:02.165353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 117/230] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2e479fdd-f898-4d67-ab4d-ef01ae0cb913 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:02.169469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:02.170345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:02.171152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:02.171760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9cd0a-d5ca-46c7-9726-c93b053741d8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.173771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 114/231] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:02.176841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e479fdd-f898-4d67-ab4d-ef01ae0cb913 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.196236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:02.264196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:02.275224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9cd0a-d5ca-46c7-9726-c93b053741d8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.284893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e479fdd-f898-4d67-ab4d-ef01ae0cb913 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.309008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6982b9-1bd8-4e38-93ec-efd71bb39bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.309647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6982b9-1bd8-4e38-93ec-efd71bb39bd1 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.309923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6982b9-1bd8-4e38-93ec-efd71bb39bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.310192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6982b9-1bd8-4e38-93ec-efd71bb39bd1 None admin] PATH_INFO: `/v3/groups` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.310813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6982b9-1bd8-4e38-93ec-efd71bb39bd1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:02.312246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6982b9-1bd8-4e38-93ec-efd71bb39bd1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:02.319539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.320232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.320522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.320784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.321592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:02.321902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:02.323395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:02.327643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 118/232] 10.222.0.47 () {60 vars in 1134 bytes} [Fri Oct 14 12:47:02 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:02.328639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6982b9-1bd8-4e38-93ec-efd71bb39bd1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.332274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 115/233] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:02.337918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.431160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:02.442146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6982b9-1bd8-4e38-93ec-efd71bb39bd1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.460295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500b5ee-ae21-4670-81e3-b48ed723b62b None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.480892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d52e0-aafd-4df8-9b09-1afcd60d6106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.481833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d52e0-aafd-4df8-9b09-1afcd60d6106 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.482108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d52e0-aafd-4df8-9b09-1afcd60d6106 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.482378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d52e0-aafd-4df8-9b09-1afcd60d6106 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.494874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d52e0-aafd-4df8-9b09-1afcd60d6106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:02.498021 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083ad55-668a-4a9a-8856-687f89c76091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.498657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ad55-668a-4a9a-8856-687f89c76091 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.498929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ad55-668a-4a9a-8856-687f89c76091 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.499194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ad55-668a-4a9a-8856-687f89c76091 None admin] PATH_INFO: `/v3/users/6ccaadae2aac4ffd83010620b349ae89` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f32d52e0-aafd-4df8-9b09-1afcd60d6106 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:02.500231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:02.501079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:02.502086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 119/234] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:02.510459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d52e0-aafd-4df8-9b09-1afcd60d6106 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.518975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083ad55-668a-4a9a-8856-687f89c76091 None admin] RBAC: Authorizing `identity:get_user(user_id=6ccaadae2aac4ffd83010620b349ae89)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:02.520735 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083ad55-668a-4a9a-8856-687f89c76091 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:02.523438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 116/235] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:02 2022] GET /identity/v3/users/6ccaadae2aac4ffd83010620b349ae89 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:02.525092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:02.529396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083ad55-668a-4a9a-8856-687f89c76091 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.616854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d52e0-aafd-4df8-9b09-1afcd60d6106 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.640073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083ad55-668a-4a9a-8856-687f89c76091 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.653582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.654198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.654470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.654738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.655401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:02.655705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:02.657081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:02.665928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 120/236] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:02.671245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.677026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.677667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.677949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.678222 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.678954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] RBAC: Adding query filter params (role.id=d7cac0839e014250a46eec827e0e2256, user.id=6ccaadae2aac4ffd83010620b349ae89, scope.system=all) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:02.679260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:02.680697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:02.684241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:02.698081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 117/237] 10.222.0.47 () {56 vars in 1308 bytes} [Fri Oct 14 12:47:02 2022] GET /identity/v3/role_assignments?user.id=6ccaadae2aac4ffd83010620b349ae89&scope.system=all&role.id=d7cac0839e014250a46eec827e0e2256 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:02.755625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:02.790962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddafdf-919c-4e4f-89de-533b2ac2ba8d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.828012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d025cf5-d0a5-4909-93b4-fd2f25062445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.828656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d025cf5-d0a5-4909-93b4-fd2f25062445 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.828934 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d025cf5-d0a5-4909-93b4-fd2f25062445 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.829203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d025cf5-d0a5-4909-93b4-fd2f25062445 None admin] PATH_INFO: `/v3/users/4720048c990348f983a89d9fa34af3b0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.830400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d025cf5-d0a5-4909-93b4-fd2f25062445 None admin] RBAC: Authorizing `identity:get_user(user_id=4720048c990348f983a89d9fa34af3b0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:02.831916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d025cf5-d0a5-4909-93b4-fd2f25062445 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:02.833846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 121/238] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:02 2022] GET /identity/v3/users/4720048c990348f983a89d9fa34af3b0 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:02.841359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:02.946740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc5a0c-a293-46d8-aa93-698831e531ea None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:02.985340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab4cf0-8d54-48aa-bb5a-b16d552f8964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:02.986031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab4cf0-8d54-48aa-bb5a-b16d552f8964 None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:02.986306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab4cf0-8d54-48aa-bb5a-b16d552f8964 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:02.986572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab4cf0-8d54-48aa-bb5a-b16d552f8964 None admin] PATH_INFO: `/v3/system/users/4720048c990348f983a89d9fa34af3b0/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:02.987980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab4cf0-8d54-48aa-bb5a-b16d552f8964 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4720048c990348f983a89d9fa34af3b0, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:02.989357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab4cf0-8d54-48aa-bb5a-b16d552f8964 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:02.999304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 118/239] 10.222.0.47 () {58 vars in 1334 bytes} [Fri Oct 14 12:47:02 2022] PUT /identity/v3/system/users/4720048c990348f983a89d9fa34af3b0/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:04.509446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f90c8-cd28-47e8-8b9a-b0e6f958f49e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.509973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f90c8-cd28-47e8-8b9a-b0e6f958f49e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.510047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f90c8-cd28-47e8-8b9a-b0e6f958f49e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.511380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 122/240] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:04.516443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7150-d901-4861-be21-8b7e799dbd17 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.516814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7150-d901-4861-be21-8b7e799dbd17 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.516995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7150-d901-4861-be21-8b7e799dbd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.535227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2fee7150-d901-4861-be21-8b7e799dbd17 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:04.536400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2fee7150-d901-4861-be21-8b7e799dbd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:04.598077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:04.609833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 119/241] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:04.841037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cfa27-3d3e-4380-9ac6-85d0aef85a14 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.841384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cfa27-3d3e-4380-9ac6-85d0aef85a14 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.841629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cfa27-3d3e-4380-9ac6-85d0aef85a14 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.843147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 123/242] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:04.848046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0bf84-99bf-4115-85eb-7d9284b07a55 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.848335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0bf84-99bf-4115-85eb-7d9284b07a55 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.848607 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0bf84-99bf-4115-85eb-7d9284b07a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.867434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f0b0bf84-99bf-4115-85eb-7d9284b07a55 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:04.868619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f0b0bf84-99bf-4115-85eb-7d9284b07a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:04.874362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cfa27-3d3e-4380-9ac6-85d0aef85a14 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:04.940735 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 120/243] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:05.002937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cfa27-3d3e-4380-9ac6-85d0aef85a14 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.041815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5f052-b31a-4527-8f34-fb3b9035205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.042465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f052-b31a-4527-8f34-fb3b9035205d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.042746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f052-b31a-4527-8f34-fb3b9035205d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.043013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f052-b31a-4527-8f34-fb3b9035205d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.044181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5f052-b31a-4527-8f34-fb3b9035205d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.045794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5f052-b31a-4527-8f34-fb3b9035205d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.047664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 124/244] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:05.053084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0bf84-99bf-4115-85eb-7d9284b07a55 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.141097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77013f3-85b9-483d-adec-1fa9427bfd06 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.141349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77013f3-85b9-483d-adec-1fa9427bfd06 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.141601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77013f3-85b9-483d-adec-1fa9427bfd06 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.143095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 125/245] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:05.148536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fb9bb-4345-4746-8d5f-ea7ea308fdbe None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.148813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fb9bb-4345-4746-8d5f-ea7ea308fdbe None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.149084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fb9bb-4345-4746-8d5f-ea7ea308fdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.152823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0bf84-99bf-4115-85eb-7d9284b07a55 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.166528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1a2fb9bb-4345-4746-8d5f-ea7ea308fdbe None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:05.167698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1a2fb9bb-4345-4746-8d5f-ea7ea308fdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:05.169660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.177507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.191555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6465da-e997-4c58-8ca8-8707d8717e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.192243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6465da-e997-4c58-8ca8-8707d8717e3c None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.192775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6465da-e997-4c58-8ca8-8707d8717e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.193049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6465da-e997-4c58-8ca8-8707d8717e3c None admin] PATH_INFO: `/v3/groups` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.194571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6465da-e997-4c58-8ca8-8707d8717e3c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.196006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6465da-e997-4c58-8ca8-8707d8717e3c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.212808 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 121/246] 10.222.0.47 () {60 vars in 1134 bytes} [Fri Oct 14 12:47:05 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:05.213704 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6465da-e997-4c58-8ca8-8707d8717e3c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.240619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 126/247] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:05.323322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6465da-e997-4c58-8ca8-8707d8717e3c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.360101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddd895-0a02-43a7-8650-6c5d0ff1c6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.360799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddd895-0a02-43a7-8650-6c5d0ff1c6ee None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.361076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddd895-0a02-43a7-8650-6c5d0ff1c6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.361367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddd895-0a02-43a7-8650-6c5d0ff1c6ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.373318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddd895-0a02-43a7-8650-6c5d0ff1c6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-a0ddd895-0a02-43a7-8650-6c5d0ff1c6ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:05.378811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:05.379700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:05.380496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 122/248] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:05.385755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fb9bb-4345-4746-8d5f-ea7ea308fdbe None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.489189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fb9bb-4345-4746-8d5f-ea7ea308fdbe None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.511672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddd895-0a02-43a7-8650-6c5d0ff1c6ee None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.530927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.531714 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.532393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.532670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.533338 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:05.533788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.535161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.542866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.546697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 127/249] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:05.554821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.576153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.653093 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddd895-0a02-43a7-8650-6c5d0ff1c6ee None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.680755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e2b82-f110-4d6a-8b95-da4ab2192c58 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.700075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f670c-92b1-4ed3-8d64-a528be7f973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.700693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f670c-92b1-4ed3-8d64-a528be7f973f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.700972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f670c-92b1-4ed3-8d64-a528be7f973f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.701240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f670c-92b1-4ed3-8d64-a528be7f973f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.713391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f670c-92b1-4ed3-8d64-a528be7f973f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:05.718671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730e3e2-ff68-4572-a4b1-7dcdbdb36a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.719313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730e3e2-ff68-4572-a4b1-7dcdbdb36a45 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.719593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730e3e2-ff68-4572-a4b1-7dcdbdb36a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.719863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730e3e2-ff68-4572-a4b1-7dcdbdb36a45 None admin] PATH_INFO: `/v3/users/6ccaadae2aac4ffd83010620b349ae89` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.721007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730e3e2-ff68-4572-a4b1-7dcdbdb36a45 None admin] RBAC: Authorizing `identity:get_user(user_id=6ccaadae2aac4ffd83010620b349ae89)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-da0f670c-92b1-4ed3-8d64-a528be7f973f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:05.721524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:05.722387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:05.723587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:05.724559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730e3e2-ff68-4572-a4b1-7dcdbdb36a45 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.724639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 123/250] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:05.724706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 128/251] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:05 2022] GET /identity/v3/users/6ccaadae2aac4ffd83010620b349ae89 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:05.728710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f670c-92b1-4ed3-8d64-a528be7f973f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.729982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730e3e2-ff68-4572-a4b1-7dcdbdb36a45 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.814649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.860847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730e3e2-ff68-4572-a4b1-7dcdbdb36a45 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.864604 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f670c-92b1-4ed3-8d64-a528be7f973f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.868351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.910229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.910977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5dba-7d91-4d18-b1fa-86c081159584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.911643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5dba-7d91-4d18-b1fa-86c081159584 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.911921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5dba-7d91-4d18-b1fa-86c081159584 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.912192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5dba-7d91-4d18-b1fa-86c081159584 None admin] PATH_INFO: `/v3/system/users/6ccaadae2aac4ffd83010620b349ae89/roles/d7cac0839e014250a46eec827e0e2256` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.912290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.912527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.913320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.914163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] RBAC: Adding query filter params (name=member) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:05.914267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5dba-7d91-4d18-b1fa-86c081159584 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6ccaadae2aac4ffd83010620b349ae89, role_id=d7cac0839e014250a46eec827e0e2256)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.914471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.915672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5dba-7d91-4d18-b1fa-86c081159584 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.915863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.926345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 124/253] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:05.926510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 129/253] 10.222.0.47 () {58 vars in 1334 bytes} [Fri Oct 14 12:47:05 2022] PUT /identity/v3/system/users/6ccaadae2aac4ffd83010620b349ae89/roles/d7cac0839e014250a46eec827e0e2256 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:05.932654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5dba-7d91-4d18-b1fa-86c081159584 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:06.080888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5dba-7d91-4d18-b1fa-86c081159584 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:06.115201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:06.124506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337babd-11d1-462d-9f17-53d23653af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:06.125253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337babd-11d1-462d-9f17-53d23653af0e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:06.125559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337babd-11d1-462d-9f17-53d23653af0e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:06.126671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337babd-11d1-462d-9f17-53d23653af0e None admin] PATH_INFO: `/v3/users/4720048c990348f983a89d9fa34af3b0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:06.127855 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337babd-11d1-462d-9f17-53d23653af0e None admin] RBAC: Authorizing `identity:get_user(user_id=4720048c990348f983a89d9fa34af3b0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:06.129386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337babd-11d1-462d-9f17-53d23653af0e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:06.131109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 130/254] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:05 2022] GET /identity/v3/users/4720048c990348f983a89d9fa34af3b0 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:06.137130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:06.255549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81debae2-5c8a-4ae5-aa92-5adaaa43e828 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:06.292410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e81c7-0da9-4dd3-8919-a51e6a1c8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:06.293349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e81c7-0da9-4dd3-8919-a51e6a1c8f1a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:06.293825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e81c7-0da9-4dd3-8919-a51e6a1c8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:06.294288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e81c7-0da9-4dd3-8919-a51e6a1c8f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:06.295252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e81c7-0da9-4dd3-8919-a51e6a1c8f1a None admin] RBAC: Adding query filter params (role.id=a754d895803642e894fc6ccc699d51d9, user.id=4720048c990348f983a89d9fa34af3b0, scope.system=all) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:06.295758 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e81c7-0da9-4dd3-8919-a51e6a1c8f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:06.297371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e81c7-0da9-4dd3-8919-a51e6a1c8f1a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:06.311031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 125/255] 10.222.0.47 () {56 vars in 1308 bytes} [Fri Oct 14 12:47:06 2022] GET /identity/v3/role_assignments?user.id=4720048c990348f983a89d9fa34af3b0&scope.system=all&role.id=a754d895803642e894fc6ccc699d51d9 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:07.754211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7886-effe-42c6-9097-df1fda26ae0b None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:07.755236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7886-effe-42c6-9097-df1fda26ae0b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:07.755715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7886-effe-42c6-9097-df1fda26ae0b None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:07.758370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 131/256] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:07.763946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6378f0c-afbb-407c-bb51-18b77825b864 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:07.764882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6378f0c-afbb-407c-bb51-18b77825b864 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:07.765336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6378f0c-afbb-407c-bb51-18b77825b864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:07.790647 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a6378f0c-afbb-407c-bb51-18b77825b864 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:07.797503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a6378f0c-afbb-407c-bb51-18b77825b864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:07.829451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:07.877147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 126/257] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:47:07.884689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6936-013f-4d40-a74c-ae66f6b2f0b2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:07.884976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6936-013f-4d40-a74c-ae66f6b2f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:07.885257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6936-013f-4d40-a74c-ae66f6b2f0b2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:07.886870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 132/258] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:07.899279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dca751-164a-44f0-a9e2-8f9df66b747d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:07.899825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dca751-164a-44f0-a9e2-8f9df66b747d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:07.900288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dca751-164a-44f0-a9e2-8f9df66b747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:07.925688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-26dca751-164a-44f0-a9e2-8f9df66b747d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:07.927197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-26dca751-164a-44f0-a9e2-8f9df66b747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:07.940621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 127/259] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:47:08.263898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6936-013f-4d40-a74c-ae66f6b2f0b2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.277140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6936-013f-4d40-a74c-ae66f6b2f0b2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.281812 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eabe8-d6c1-473f-96e0-5fc82d754d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.284132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eabe8-d6c1-473f-96e0-5fc82d754d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.284711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eabe8-d6c1-473f-96e0-5fc82d754d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.285214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eabe8-d6c1-473f-96e0-5fc82d754d21 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.304107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eabe8-d6c1-473f-96e0-5fc82d754d21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a75eabe8-d6c1-473f-96e0-5fc82d754d21 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:08.309359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:08.310271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:08.311069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:08.316861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 133/260] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Oct 14 12:47:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:08.319070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dca751-164a-44f0-a9e2-8f9df66b747d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.334866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dca751-164a-44f0-a9e2-8f9df66b747d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.345509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.346117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.346388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.346654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.347330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:08.347632 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:08.349404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING py.warnings [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:08.349404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: warnings.warn(msg) Oct 14 12:47:08.349404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: Oct 14 12:47:08.354440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:08.364470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 128/261] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:47:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:08.370498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eabe8-d6c1-473f-96e0-5fc82d754d21 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.382393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eabe8-d6c1-473f-96e0-5fc82d754d21 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.390225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.391158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.391649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.392170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] PATH_INFO: `/v3/groups/cd2626f3534d434c838f1c202be3b8a1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.399272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] RBAC: Authorizing `identity:get_group(group_id=cd2626f3534d434c838f1c202be3b8a1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:08.401327 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:08.401327 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:47:08.401327 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:47:08.403047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:08.405200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 134/262] 10.222.0.47 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:08 2022] GET /identity/v3/groups/cd2626f3534d434c838f1c202be3b8a1 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:08.410452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.426904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c650fed-a67f-49ca-ad2e-2804ba674791 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.438101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4ce26-835e-4b36-b785-b023ba3b5599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.438742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4ce26-835e-4b36-b785-b023ba3b5599 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.439006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4ce26-835e-4b36-b785-b023ba3b5599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.439273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4ce26-835e-4b36-b785-b023ba3b5599 admin admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.440435 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4ce26-835e-4b36-b785-b023ba3b5599 admin admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:08.442550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4ce26-835e-4b36-b785-b023ba3b5599 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:08.444715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 129/263] 10.222.0.47 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:08 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:08.450517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.463671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c281c-16a1-4cbc-b972-1805ef03d465 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.467441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4ce26-835e-4b36-b785-b023ba3b5599 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.469153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.470125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.470639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.471111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/groups/cd2626f3534d434c838f1c202be3b8a1/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.473735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dac6f39ae14d2bb0f24a58291ce28d, group_id=cd2626f3534d434c838f1c202be3b8a1, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:08.475130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:08.475130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:47:08.475130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:47:08.477720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:08.483063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4ce26-835e-4b36-b785-b023ba3b5599 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.498265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46d48-6de0-432a-9c26-e7ecd9386e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.498958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46d48-6de0-432a-9c26-e7ecd9386e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.499234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46d48-6de0-432a-9c26-e7ecd9386e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.499508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f46d48-6de0-432a-9c26-e7ecd9386e8d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.508037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 135/264] 10.222.0.47 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:08 2022] PUT /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/groups/cd2626f3534d434c838f1c202be3b8a1/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:08.522744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f46d48-6de0-432a-9c26-e7ecd9386e8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-94f46d48-6de0-432a-9c26-e7ecd9386e8d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:08.528256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:08.529214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:08.530088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:08.533636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 130/265] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Oct 14 12:47:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:08.535937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.630936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7a8ac-b2e2-4c1d-86a4-b912a948730f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.641599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.642687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.643225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.643746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.644690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:08.645196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:08.646531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:08.646531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:47:08.646531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:47:08.650694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:08.661458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 136/266] 10.222.0.47 () {56 vars in 1132 bytes} [Fri Oct 14 12:47:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:08.667854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46d48-6de0-432a-9c26-e7ecd9386e8d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.684405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f46d48-6de0-432a-9c26-e7ecd9386e8d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.692934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.693624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.694461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] PATH_INFO: `/v3/groups/cd2626f3534d434c838f1c202be3b8a1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.702446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] RBAC: Authorizing `identity:get_group(group_id=cd2626f3534d434c838f1c202be3b8a1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:08.703486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING py.warnings [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:08.703486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: warnings.warn(msg) Oct 14 12:47:08.703486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: Oct 14 12:47:08.704735 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:08.706449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 131/267] 10.222.0.47 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:08 2022] GET /identity/v3/groups/cd2626f3534d434c838f1c202be3b8a1 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:08.712208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.723884 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acce0e4-7a7f-4947-910c-bbb01326493d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.733371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc57e0-192f-4c16-9613-c4661acfc780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.734757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc57e0-192f-4c16-9613-c4661acfc780 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.735243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc57e0-192f-4c16-9613-c4661acfc780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.735806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc57e0-192f-4c16-9613-c4661acfc780 admin admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.737325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc57e0-192f-4c16-9613-c4661acfc780 admin admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:08.739854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc57e0-192f-4c16-9613-c4661acfc780 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:08.742507 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 137/268] 10.222.0.47 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:08 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:08.748765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:08.763120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b313bf-0b79-4225-a541-73bcc8d10568 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:08.769178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd28909-c4ba-43a8-abc7-6c8a1570489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:08.769904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28909-c4ba-43a8-abc7-6c8a1570489b admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.770154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28909-c4ba-43a8-abc7-6c8a1570489b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.770422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28909-c4ba-43a8-abc7-6c8a1570489b admin admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/groups/cd2626f3534d434c838f1c202be3b8a1/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.773225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28909-c4ba-43a8-abc7-6c8a1570489b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dac6f39ae14d2bb0f24a58291ce28d, group_id=cd2626f3534d434c838f1c202be3b8a1, role_id=7d7ee6a7e93f46e5bff0a079bfb7ea3e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:08.774253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING py.warnings [None req-afd28909-c4ba-43a8-abc7-6c8a1570489b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:08.774253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: warnings.warn(msg) Oct 14 12:47:08.774253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: Oct 14 12:47:08.776295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28909-c4ba-43a8-abc7-6c8a1570489b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:08.796538 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 132/269] 10.222.0.47 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:08 2022] PUT /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d/groups/cd2626f3534d434c838f1c202be3b8a1/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:09.244046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e96f9-19ac-4e40-ae89-f820e1fe7576 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:09.244560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e96f9-19ac-4e40-ae89-f820e1fe7576 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:09.244885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e96f9-19ac-4e40-ae89-f820e1fe7576 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:09.246542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 138/270] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:09.252181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846a7b-7d0f-4633-8b6c-c60bcdd791d1 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:09.252591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846a7b-7d0f-4633-8b6c-c60bcdd791d1 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:09.252972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846a7b-7d0f-4633-8b6c-c60bcdd791d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:09.277982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-55846a7b-7d0f-4633-8b6c-c60bcdd791d1 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:09.279175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-55846a7b-7d0f-4633-8b6c-c60bcdd791d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:09.311413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfea6-4e30-4e06-8bcb-ad003f2cd66c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:09.311731 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfea6-4e30-4e06-8bcb-ad003f2cd66c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:09.311975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dfea6-4e30-4e06-8bcb-ad003f2cd66c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:09.313598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 139/271] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:09.322948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85395cc-be8a-498b-a6f3-6539d3c76d59 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:09.323258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85395cc-be8a-498b-a6f3-6539d3c76d59 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:09.323519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85395cc-be8a-498b-a6f3-6539d3c76d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:09.359570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e85395cc-be8a-498b-a6f3-6539d3c76d59 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:09.361702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e85395cc-be8a-498b-a6f3-6539d3c76d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:09.372405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 133/272] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:09.437417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 140/273] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 14 12:47:09.879059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55846a7b-7d0f-4633-8b6c-c60bcdd791d1 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:09.935288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:09.988084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55846a7b-7d0f-4633-8b6c-c60bcdd791d1 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.036052 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b202-ce7c-4a50-b80d-2216e932e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.036702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b202-ce7c-4a50-b80d-2216e932e70c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.036975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b202-ce7c-4a50-b80d-2216e932e70c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.037242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b202-ce7c-4a50-b80d-2216e932e70c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.051565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5b202-ce7c-4a50-b80d-2216e932e70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-82e5b202-ce7c-4a50-b80d-2216e932e70c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:10.057028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:10.057958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:10.059145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 134/274] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:10.061297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85395cc-be8a-498b-a6f3-6539d3c76d59 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.068598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b202-ce7c-4a50-b80d-2216e932e70c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.071763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85395cc-be8a-498b-a6f3-6539d3c76d59 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.082100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181f30-551a-4cbf-904b-673417d2e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.082736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181f30-551a-4cbf-904b-673417d2e149 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.083003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181f30-551a-4cbf-904b-673417d2e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.083264 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181f30-551a-4cbf-904b-673417d2e149 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.101567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75181f30-551a-4cbf-904b-673417d2e149 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-75181f30-551a-4cbf-904b-673417d2e149 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:10.106429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:10.107331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:10.108139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 141/275] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:10.119037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181f30-551a-4cbf-904b-673417d2e149 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.136284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181f30-551a-4cbf-904b-673417d2e149 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.153565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.154184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.154710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.155373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:10.155668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.157280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.169526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 142/276] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:10.176801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.195243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d43f8-4dcc-41b0-b78b-ed2859b0de31 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.208667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c038e-3f01-4751-9cc2-25da5b8cf1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.209330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c038e-3f01-4751-9cc2-25da5b8cf1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.209629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c038e-3f01-4751-9cc2-25da5b8cf1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.209894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c038e-3f01-4751-9cc2-25da5b8cf1a7 admin admin] PATH_INFO: `/v3/groups/cd2626f3534d434c838f1c202be3b8a1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.211741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c038e-3f01-4751-9cc2-25da5b8cf1a7 admin admin] RBAC: Authorizing `identity:get_group(group_id=cd2626f3534d434c838f1c202be3b8a1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.213682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c038e-3f01-4751-9cc2-25da5b8cf1a7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.215422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 143/277] 10.222.0.47 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/groups/cd2626f3534d434c838f1c202be3b8a1 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:10.225183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c038e-3f01-4751-9cc2-25da5b8cf1a7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.241723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c038e-3f01-4751-9cc2-25da5b8cf1a7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.255118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8f2d-d342-4c2c-bd1f-f29bcbc8b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.255810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8f2d-d342-4c2c-bd1f-f29bcbc8b04b admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.256016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8f2d-d342-4c2c-bd1f-f29bcbc8b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.256854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8f2d-d342-4c2c-bd1f-f29bcbc8b04b admin admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.258641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc8f2d-d342-4c2c-bd1f-f29bcbc8b04b admin admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.260706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc8f2d-d342-4c2c-bd1f-f29bcbc8b04b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.262353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 144/278] 10.222.0.47 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:10.263452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264860-b0e1-4ddc-94aa-265286bc42a0 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.263722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264860-b0e1-4ddc-94aa-265286bc42a0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.263987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264860-b0e1-4ddc-94aa-265286bc42a0 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.265159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 145/279] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:10.274709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b202-ce7c-4a50-b80d-2216e932e70c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.276708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a82e-adc7-4694-95d4-4e561b2d4690 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.276979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a82e-adc7-4694-95d4-4e561b2d4690 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.277246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01a82e-adc7-4694-95d4-4e561b2d4690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.296732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:10.309240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4f01a82e-adc7-4694-95d4-4e561b2d4690 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:10.310454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4f01a82e-adc7-4694-95d4-4e561b2d4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:10.318330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 146/280] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:47:10.319653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01a82e-adc7-4694-95d4-4e561b2d4690 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.331708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01a82e-adc7-4694-95d4-4e561b2d4690 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.337286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f607-2b65-4344-884b-4140c25f940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.338513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f607-2b65-4344-884b-4140c25f940a admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.338957 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f607-2b65-4344-884b-4140c25f940a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.339366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78f607-2b65-4344-884b-4140c25f940a admin admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/groups/cd2626f3534d434c838f1c202be3b8a1/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.341356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78f607-2b65-4344-884b-4140c25f940a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a700d82f30b94310b8df3cf9c3ae44c2, group_id=cd2626f3534d434c838f1c202be3b8a1, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.344401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78f607-2b65-4344-884b-4140c25f940a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.354237 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.354865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.355215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.355452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.356201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:10.356553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.357998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.366297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 147/281] 10.222.0.47 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:10 2022] PUT /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/groups/cd2626f3534d434c838f1c202be3b8a1/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:10.379814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 135/282] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:10.386024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f607-2b65-4344-884b-4140c25f940a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.406285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:10.514321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78f607-2b65-4344-884b-4140c25f940a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.551782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dada518-5684-4120-9db5-228990732950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.552416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada518-5684-4120-9db5-228990732950 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.552687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada518-5684-4120-9db5-228990732950 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.552953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada518-5684-4120-9db5-228990732950 None admin] PATH_INFO: `/v3/users/6ccaadae2aac4ffd83010620b349ae89` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.554277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dada518-5684-4120-9db5-228990732950 None admin] RBAC: Authorizing `identity:get_user(user_id=6ccaadae2aac4ffd83010620b349ae89)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.555743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dada518-5684-4120-9db5-228990732950 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.557806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 148/283] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/users/6ccaadae2aac4ffd83010620b349ae89 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:10.563443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.695261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dada518-5684-4120-9db5-228990732950 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.717334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7748-6905-4765-8fc2-fb4d8f11ead7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.770112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dada518-5684-4120-9db5-228990732950 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.775044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f92e-736d-43b3-bde4-9d6f982c872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.775930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f92e-736d-43b3-bde4-9d6f982c872e admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.776431 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f92e-736d-43b3-bde4-9d6f982c872e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.776896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f92e-736d-43b3-bde4-9d6f982c872e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.780694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.781257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.781586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.781861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.782602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] RBAC: Adding query filter params (role.id=d7cac0839e014250a46eec827e0e2256, user.id=6ccaadae2aac4ffd83010620b349ae89, scope.system=all) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:10.782907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.784349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.790702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9f92e-736d-43b3-bde4-9d6f982c872e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-6db9f92e-736d-43b3-bde4-9d6f982c872e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:10.795978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:10.796885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:10.797730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:10.800012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 149/284] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:10.806346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f92e-736d-43b3-bde4-9d6f982c872e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.808928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 136/285] 10.222.0.47 () {56 vars in 1308 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/role_assignments?user.id=6ccaadae2aac4ffd83010620b349ae89&scope.system=all&role.id=d7cac0839e014250a46eec827e0e2256 => generated 510 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:10.818115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f92e-736d-43b3-bde4-9d6f982c872e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.823668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.824627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.825101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.825616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.826522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:10.827056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.828900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.839240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 150/286] 10.222.0.47 () {56 vars in 1132 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:10.845309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.874671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dadfa9-8a8e-4f5d-9b2f-fc703e36d176 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.882980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33543c-da39-4a17-b624-f7e8a4b61860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.883633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33543c-da39-4a17-b624-f7e8a4b61860 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.883889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33543c-da39-4a17-b624-f7e8a4b61860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.884155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33543c-da39-4a17-b624-f7e8a4b61860 admin admin] PATH_INFO: `/v3/groups/cd2626f3534d434c838f1c202be3b8a1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.885272 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33543c-da39-4a17-b624-f7e8a4b61860 admin admin] RBAC: Authorizing `identity:get_group(group_id=cd2626f3534d434c838f1c202be3b8a1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.887260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33543c-da39-4a17-b624-f7e8a4b61860 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.888984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 137/287] 10.222.0.47 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/groups/cd2626f3534d434c838f1c202be3b8a1 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:10.894710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.900122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:10.912474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066571c3-ec0b-4d4d-b535-b2d2723be88f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.917239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00072cf-48c2-4d1b-ac81-bff2a77eb599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.918115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00072cf-48c2-4d1b-ac81-bff2a77eb599 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.918590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00072cf-48c2-4d1b-ac81-bff2a77eb599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.919096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00072cf-48c2-4d1b-ac81-bff2a77eb599 admin admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.920420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00072cf-48c2-4d1b-ac81-bff2a77eb599 admin admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.922737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00072cf-48c2-4d1b-ac81-bff2a77eb599 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.924595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 151/288] 10.222.0.47 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:10 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:10.931054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33543c-da39-4a17-b624-f7e8a4b61860 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:10.947680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33543c-da39-4a17-b624-f7e8a4b61860 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:10.957880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06ba52-290b-4f6f-a6f6-c5b5750a1e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:10.958561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06ba52-290b-4f6f-a6f6-c5b5750a1e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:10.958831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06ba52-290b-4f6f-a6f6-c5b5750a1e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:10.959099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06ba52-290b-4f6f-a6f6-c5b5750a1e6d admin admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/groups/cd2626f3534d434c838f1c202be3b8a1/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:10.967648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06ba52-290b-4f6f-a6f6-c5b5750a1e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a700d82f30b94310b8df3cf9c3ae44c2, group_id=cd2626f3534d434c838f1c202be3b8a1, role_id=7d7ee6a7e93f46e5bff0a079bfb7ea3e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:10.970384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06ba52-290b-4f6f-a6f6-c5b5750a1e6d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:10.995708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 138/289] 10.222.0.47 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:10 2022] PUT /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2/groups/cd2626f3534d434c838f1c202be3b8a1/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:11.123677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dced53-9200-46bf-8639-1ca354cb3e5d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.124382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dced53-9200-46bf-8639-1ca354cb3e5d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.124867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dced53-9200-46bf-8639-1ca354cb3e5d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.126742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 152/290] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:11.132675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950005a-e3cb-494c-8c91-6d3fe3275497 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.132950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950005a-e3cb-494c-8c91-6d3fe3275497 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.133217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950005a-e3cb-494c-8c91-6d3fe3275497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.163934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8950005a-e3cb-494c-8c91-6d3fe3275497 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:11.165177 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8950005a-e3cb-494c-8c91-6d3fe3275497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:11.183053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:11.246050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 139/291] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:47:11.669420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dced53-9200-46bf-8639-1ca354cb3e5d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:11.683791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dced53-9200-46bf-8639-1ca354cb3e5d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:11.688334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae51437-3e22-4d1f-8c74-ba06bf77db82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:11.689210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae51437-3e22-4d1f-8c74-ba06bf77db82 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.689722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae51437-3e22-4d1f-8c74-ba06bf77db82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.690188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae51437-3e22-4d1f-8c74-ba06bf77db82 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.705942 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae51437-3e22-4d1f-8c74-ba06bf77db82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-2ae51437-3e22-4d1f-8c74-ba06bf77db82 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:11.713530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:11.714433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:11.715222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:11.719461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 153/292] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Oct 14 12:47:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:11.725069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950005a-e3cb-494c-8c91-6d3fe3275497 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:11.734755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950005a-e3cb-494c-8c91-6d3fe3275497 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:11.739459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:11.740323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.741322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.745873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.746824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:11.747337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:11.749158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:11.754084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897ae24-7435-4f10-bad2-681b03cdd29c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.754428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897ae24-7435-4f10-bad2-681b03cdd29c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.754703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897ae24-7435-4f10-bad2-681b03cdd29c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.756137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 154/293] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:11.762728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830de7-cba6-48b6-a59b-4a2c31eb0ba3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.763006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830de7-cba6-48b6-a59b-4a2c31eb0ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.763294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830de7-cba6-48b6-a59b-4a2c31eb0ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.763511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 140/294] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Oct 14 12:47:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:11.768184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:11.783387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f2d09-9c6e-4a64-ae47-f51237f0e70b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:11.783708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ac830de7-cba6-48b6-a59b-4a2c31eb0ba3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:11.784894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ac830de7-cba6-48b6-a59b-4a2c31eb0ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:11.789892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4031e1c-ffab-4644-a2c1-40902d6cc574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:11.790808 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4031e1c-ffab-4644-a2c1-40902d6cc574 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.791303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4031e1c-ffab-4644-a2c1-40902d6cc574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.791770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4031e1c-ffab-4644-a2c1-40902d6cc574 admin admin] PATH_INFO: `/v3/groups/999b58ac9a99457189fdfa69f8e0a1f4` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.804088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4031e1c-ffab-4644-a2c1-40902d6cc574 admin admin] RBAC: Authorizing `identity:get_group(group_id=999b58ac9a99457189fdfa69f8e0a1f4)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:11.807592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4031e1c-ffab-4644-a2c1-40902d6cc574 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:11.813602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 141/295] 10.222.0.47 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:11 2022] GET /identity/v3/groups/999b58ac9a99457189fdfa69f8e0a1f4 => generated 229 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:11.818449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4031e1c-ffab-4644-a2c1-40902d6cc574 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:11.840263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4031e1c-ffab-4644-a2c1-40902d6cc574 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:11.856155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c12983-1db3-43ae-a7f5-ed7e9426c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:11.856766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c12983-1db3-43ae-a7f5-ed7e9426c887 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.857028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c12983-1db3-43ae-a7f5-ed7e9426c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.857295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c12983-1db3-43ae-a7f5-ed7e9426c887 admin admin] PATH_INFO: `/v3/projects/48f83413dd8d497d98e9b13f0fa4b793` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.862784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c12983-1db3-43ae-a7f5-ed7e9426c887 admin admin] RBAC: Authorizing `identity:get_project(project_id=48f83413dd8d497d98e9b13f0fa4b793)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:11.864224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c12983-1db3-43ae-a7f5-ed7e9426c887 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:11.866951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 142/296] 10.222.0.47 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:11 2022] GET /identity/v3/projects/48f83413dd8d497d98e9b13f0fa4b793 => generated 344 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:11.872587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c12983-1db3-43ae-a7f5-ed7e9426c887 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:11.875104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 155/297] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:11.890616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c12983-1db3-43ae-a7f5-ed7e9426c887 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:11.901161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f6764-9e23-4308-8b1f-882eca4397e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:11.902706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6764-9e23-4308-8b1f-882eca4397e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.903492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6764-9e23-4308-8b1f-882eca4397e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.904086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6764-9e23-4308-8b1f-882eca4397e3 admin admin] PATH_INFO: `/v3/projects/48f83413dd8d497d98e9b13f0fa4b793/groups/999b58ac9a99457189fdfa69f8e0a1f4/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.906268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f6764-9e23-4308-8b1f-882eca4397e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f83413dd8d497d98e9b13f0fa4b793, group_id=999b58ac9a99457189fdfa69f8e0a1f4, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:11.909146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f6764-9e23-4308-8b1f-882eca4397e3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:11.934244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 143/298] 10.222.0.47 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:11 2022] PUT /identity/v3/projects/48f83413dd8d497d98e9b13f0fa4b793/groups/999b58ac9a99457189fdfa69f8e0a1f4/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:12.010983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b9b8d-3a27-4faf-aa2c-8257c9f736da None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:12.011610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b9b8d-3a27-4faf-aa2c-8257c9f736da None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:12.012116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b9b8d-3a27-4faf-aa2c-8257c9f736da None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:12.013934 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 156/299] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:12.020385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a020-bd06-49ef-89c1-28bd4df00663 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:12.021008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a020-bd06-49ef-89c1-28bd4df00663 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:12.021510 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553a020-bd06-49ef-89c1-28bd4df00663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:12.042348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-6553a020-bd06-49ef-89c1-28bd4df00663 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:12.043949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6553a020-bd06-49ef-89c1-28bd4df00663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:12.117764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 144/300] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:12.365706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b9b8d-3a27-4faf-aa2c-8257c9f736da None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:12.409995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553a020-bd06-49ef-89c1-28bd4df00663 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:12.488273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:12.491214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b9b8d-3a27-4faf-aa2c-8257c9f736da None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:12.529385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:12.566247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553a020-bd06-49ef-89c1-28bd4df00663 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:12.569362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f99b6-7488-49ee-a2e9-6094384817cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:12.570040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f99b6-7488-49ee-a2e9-6094384817cc None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:12.570305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f99b6-7488-49ee-a2e9-6094384817cc None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:12.570568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f99b6-7488-49ee-a2e9-6094384817cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:12.596024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f99b6-7488-49ee-a2e9-6094384817cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-ce6f99b6-7488-49ee-a2e9-6094384817cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:12.600949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:12.601868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:12.603224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 157/301] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:12.607621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f99b6-7488-49ee-a2e9-6094384817cc None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:12.647733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ddbc-436c-4adb-84bc-0fe61dcb0302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:12.649527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ddbc-436c-4adb-84bc-0fe61dcb0302 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:12.650634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ddbc-436c-4adb-84bc-0fe61dcb0302 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:12.651129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ddbc-436c-4adb-84bc-0fe61dcb0302 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:12.672007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327ddbc-436c-4adb-84bc-0fe61dcb0302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-e327ddbc-436c-4adb-84bc-0fe61dcb0302 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:12.681713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:12.682628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:12.683411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:12.685863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 145/302] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:12.692766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ddbc-436c-4adb-84bc-0fe61dcb0302 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:12.769819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f99b6-7488-49ee-a2e9-6094384817cc None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:12.810522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:12.811543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:12.812012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:12.812497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:12.813465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:12.814078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:12.815643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:12.827366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 158/303] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:12.832631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:12.878287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ddbc-436c-4adb-84bc-0fe61dcb0302 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:12.899194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:12.917874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:12.927200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:12.927814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:12.928118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:12.928465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:12.929133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] RBAC: Adding query filter params (name=member) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:12.932335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:12.934756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:12.951447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 146/304] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:12.959185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:13.039815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fbddf-30c7-4a48-81ab-43b26aac2f06 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:13.114763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063de397-9c53-4e79-a4c7-402dc2e97ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:13.116341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de397-9c53-4e79-a4c7-402dc2e97ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.116811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de397-9c53-4e79-a4c7-402dc2e97ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.117268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de397-9c53-4e79-a4c7-402dc2e97ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.142998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b86ef-0090-4972-bd0b-6bea7ac7deaa None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:13.211754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dcd09-833d-4822-8a72-3a031f97b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:13.213069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dcd09-833d-4822-8a72-3a031f97b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.214292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dcd09-833d-4822-8a72-3a031f97b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.214956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dcd09-833d-4822-8a72-3a031f97b5a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.267795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063de397-9c53-4e79-a4c7-402dc2e97ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:13.269621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063de397-9c53-4e79-a4c7-402dc2e97ab9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:13.314483 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:13.352258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:13.360976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dcd09-833d-4822-8a72-3a031f97b5a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:13.362739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dcd09-833d-4822-8a72-3a031f97b5a4 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:13.441186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 159/305] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:13.447790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063de397-9c53-4e79-a4c7-402dc2e97ab9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:13.566324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 147/306] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:13.568005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878402-f90d-46fe-b96e-8e5248f40232 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.568751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878402-f90d-46fe-b96e-8e5248f40232 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.569226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878402-f90d-46fe-b96e-8e5248f40232 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.570991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 148/307] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:13.572036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878402-f90d-46fe-b96e-8e5248f40232 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:13.581297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063de397-9c53-4e79-a4c7-402dc2e97ab9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:13.627541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0a756-468f-4d3b-ac96-59fdbf1906ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:13.629077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0a756-468f-4d3b-ac96-59fdbf1906ad None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.629077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0a756-468f-4d3b-ac96-59fdbf1906ad None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.629249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0a756-468f-4d3b-ac96-59fdbf1906ad None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.630428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0a756-468f-4d3b-ac96-59fdbf1906ad None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:13.632582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0a756-468f-4d3b-ac96-59fdbf1906ad None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:13.634483 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 160/308] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:13 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:13.639179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8f68-5f24-4c01-8ebf-da40ac58cd3f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.639179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8f68-5f24-4c01-8ebf-da40ac58cd3f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.639179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8f68-5f24-4c01-8ebf-da40ac58cd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.651729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:13.660571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-adca8f68-5f24-4c01-8ebf-da40ac58cd3f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:13.661799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-adca8f68-5f24-4c01-8ebf-da40ac58cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:13.679427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:13.703651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878402-f90d-46fe-b96e-8e5248f40232 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:13.744203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 161/309] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:13.745592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca8f68-5f24-4c01-8ebf-da40ac58cd3f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:13.748915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a70cd-863f-4c0e-9395-cc1a43e0bb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:13.750638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a70cd-863f-4c0e-9395-cc1a43e0bb32 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.750873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a70cd-863f-4c0e-9395-cc1a43e0bb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.751147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a70cd-863f-4c0e-9395-cc1a43e0bb32 None admin] PATH_INFO: `/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.752961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a70cd-863f-4c0e-9395-cc1a43e0bb32 None admin] RBAC: Authorizing `identity:get_project(project_id=07dac6f39ae14d2bb0f24a58291ce28d)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:13.754497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a70cd-863f-4c0e-9395-cc1a43e0bb32 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:13.756607 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 149/310] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:13 2022] GET /identity/v3/projects/07dac6f39ae14d2bb0f24a58291ce28d => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:13.763589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a70cd-863f-4c0e-9395-cc1a43e0bb32 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:13.873339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca8f68-5f24-4c01-8ebf-da40ac58cd3f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:13.916438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dc29e-25da-4757-9ee9-f47c10417028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:13.917059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dc29e-25da-4757-9ee9-f47c10417028 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.917331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dc29e-25da-4757-9ee9-f47c10417028 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.919920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dc29e-25da-4757-9ee9-f47c10417028 None admin] PATH_INFO: `/v3/groups/cd2626f3534d434c838f1c202be3b8a1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.921519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dc29e-25da-4757-9ee9-f47c10417028 None admin] RBAC: Authorizing `identity:get_group(group_id=cd2626f3534d434c838f1c202be3b8a1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:13.923089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dc29e-25da-4757-9ee9-f47c10417028 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:13.925234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 162/311] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:13 2022] GET /identity/v3/groups/cd2626f3534d434c838f1c202be3b8a1 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:13.927279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f852-1909-4af4-a870-8661c2a3abee None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.927550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f852-1909-4af4-a870-8661c2a3abee None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.927816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944f852-1909-4af4-a870-8661c2a3abee None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.929749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 163/312] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:13.937240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944f852-1909-4af4-a870-8661c2a3abee None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:13.941196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:13.950356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a70cd-863f-4c0e-9395-cc1a43e0bb32 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:13.986426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d6587-8647-4bd9-b3f2-31dd74ed1ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:13.986426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d6587-8647-4bd9-b3f2-31dd74ed1ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.986426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d6587-8647-4bd9-b3f2-31dd74ed1ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.986675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d6587-8647-4bd9-b3f2-31dd74ed1ab5 None admin] PATH_INFO: `/v3/groups/cd2626f3534d434c838f1c202be3b8a1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:13.987570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d6587-8647-4bd9-b3f2-31dd74ed1ab5 None admin] RBAC: Authorizing `identity:get_group(group_id=cd2626f3534d434c838f1c202be3b8a1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:13.989002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d6587-8647-4bd9-b3f2-31dd74ed1ab5 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:13.993533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 150/313] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:13 2022] GET /identity/v3/groups/cd2626f3534d434c838f1c202be3b8a1 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:13.996159 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47bae-7e76-42fa-84ad-29d11c066ddf None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:13.996159 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47bae-7e76-42fa-84ad-29d11c066ddf None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:13.996159 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e47bae-7e76-42fa-84ad-29d11c066ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.013026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b3e47bae-7e76-42fa-84ad-29d11c066ddf None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:14.014448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b3e47bae-7e76-42fa-84ad-29d11c066ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:14.026545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:14.058546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944f852-1909-4af4-a870-8661c2a3abee None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:14.086821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 151/314] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:14.090431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e47bae-7e76-42fa-84ad-29d11c066ddf None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:14.094062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:14.094659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.094935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.095197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.095913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] RBAC: Adding query filter params (group.id=cd2626f3534d434c838f1c202be3b8a1, role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e, scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:14.096217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:14.097656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:14.104412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 164/315] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:13 2022] GET /identity/v3/role_assignments?group.id=cd2626f3534d434c838f1c202be3b8a1&scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d&role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:14.145065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:14.237630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e47bae-7e76-42fa-84ad-29d11c066ddf None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:14.257383 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:14.287143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:14.290036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839987f3-540b-49d5-9b20-7e9814b13d2e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:14.292220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.292499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.292766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.293545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] RBAC: Adding query filter params (group.id=cd2626f3534d434c838f1c202be3b8a1, role.id=a754d895803642e894fc6ccc699d51d9, scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:14.293857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:14.295317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:14.311415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 152/316] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:14 2022] GET /identity/v3/role_assignments?group.id=cd2626f3534d434c838f1c202be3b8a1&scope.project.id=07dac6f39ae14d2bb0f24a58291ce28d&role.id=a754d895803642e894fc6ccc699d51d9 => generated 611 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:14.341716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a912ada-5871-49ad-92dc-8a9706499478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:14.342372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912ada-5871-49ad-92dc-8a9706499478 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.342690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912ada-5871-49ad-92dc-8a9706499478 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.342960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912ada-5871-49ad-92dc-8a9706499478 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.355958 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a912ada-5871-49ad-92dc-8a9706499478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4a912ada-5871-49ad-92dc-8a9706499478 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:14.361901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:14.362828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:14.363822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 165/317] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:14.369035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:14.386580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:14.476745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a912ada-5871-49ad-92dc-8a9706499478 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:14.502793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40561faa-af96-4764-b4d4-fdaf057d195c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:14.544231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:14.545010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.545117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.545379 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.549504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:14.549504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:14.549504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:14.560485 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 153/318] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:14.566355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:14.594542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a912ada-5871-49ad-92dc-8a9706499478 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:14.623990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:14.642747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5fed-c7e1-4906-8c2b-89f2a7feddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:14.643757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5fed-c7e1-4906-8c2b-89f2a7feddba None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.644035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5fed-c7e1-4906-8c2b-89f2a7feddba None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.644302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5fed-c7e1-4906-8c2b-89f2a7feddba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.656147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:14.664670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d5fed-c7e1-4906-8c2b-89f2a7feddba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a18d5fed-c7e1-4906-8c2b-89f2a7feddba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:14.673503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:14.674413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:14.675236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 166/319] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:14.680116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5fed-c7e1-4906-8c2b-89f2a7feddba None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:14.698423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934ac98-2234-4aa7-8cb8-717c26440f33 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:14.742797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7160c3-9b02-41a7-b9f9-7a35726effc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:14.742797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7160c3-9b02-41a7-b9f9-7a35726effc2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.742797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7160c3-9b02-41a7-b9f9-7a35726effc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.743120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7160c3-9b02-41a7-b9f9-7a35726effc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.794564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5fed-c7e1-4906-8c2b-89f2a7feddba None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:14.832105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7160c3-9b02-41a7-b9f9-7a35726effc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:14.833984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7160c3-9b02-41a7-b9f9-7a35726effc2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:14.836738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:14.837615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.837959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.838298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.839035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:14.839398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:14.840886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:14.853005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 167/320] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:14.860700 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:14.925687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:14.930883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:14.965540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 154/321] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 12:47:14.966797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754d57-9c58-49e0-b0ca-028efa19e595 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.967072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754d57-9c58-49e0-b0ca-028efa19e595 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.967333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754d57-9c58-49e0-b0ca-028efa19e595 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.968888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 155/322] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:14.977219 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42a0c1-8ac8-4285-a6d9-374f43be0e0f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:14.977533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42a0c1-8ac8-4285-a6d9-374f43be0e0f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:14.978026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42a0c1-8ac8-4285-a6d9-374f43be0e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:14.990599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2f3cb-751c-4c9c-a483-450c89edbb4b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.000989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ff42a0c1-8ac8-4285-a6d9-374f43be0e0f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:15.002454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ff42a0c1-8ac8-4285-a6d9-374f43be0e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:15.031534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b307841-f9f8-478f-bd51-85db35ede8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.032417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307841-f9f8-478f-bd51-85db35ede8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.032701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307841-f9f8-478f-bd51-85db35ede8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.032975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307841-f9f8-478f-bd51-85db35ede8b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.075979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 156/323] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:15.076825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42a0c1-8ac8-4285-a6d9-374f43be0e0f None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:15.117095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b307841-f9f8-478f-bd51-85db35ede8b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:15.120453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b307841-f9f8-478f-bd51-85db35ede8b3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:15.186593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:15.205572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42a0c1-8ac8-4285-a6d9-374f43be0e0f None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.207240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:15.250258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c2739-bfb5-4f86-8cf9-5c69f8fea1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.250882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c2739-bfb5-4f86-8cf9-5c69f8fea1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.251208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c2739-bfb5-4f86-8cf9-5c69f8fea1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.251420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c2739-bfb5-4f86-8cf9-5c69f8fea1a7 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.251759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 168/324] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 12:47:15.252841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c2739-bfb5-4f86-8cf9-5c69f8fea1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:15.257737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c2739-bfb5-4f86-8cf9-5c69f8fea1a7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:15.257737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 157/325] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:15.257960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b307841-f9f8-478f-bd51-85db35ede8b3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:15.263665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c2739-bfb5-4f86-8cf9-5c69f8fea1a7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:15.387981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b307841-f9f8-478f-bd51-85db35ede8b3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.402019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c2739-bfb5-4f86-8cf9-5c69f8fea1a7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.426828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ba48c-9651-4c7e-b7ae-eb838defd910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.427465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ba48c-9651-4c7e-b7ae-eb838defd910 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.427741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ba48c-9651-4c7e-b7ae-eb838defd910 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.428536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ba48c-9651-4c7e-b7ae-eb838defd910 None admin] PATH_INFO: `/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.429760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ba48c-9651-4c7e-b7ae-eb838defd910 None admin] RBAC: Authorizing `identity:get_project(project_id=a700d82f30b94310b8df3cf9c3ae44c2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:15.431207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ba48c-9651-4c7e-b7ae-eb838defd910 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:15.433007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 169/326] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/projects/a700d82f30b94310b8df3cf9c3ae44c2 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:15.433620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ba48c-9651-4c7e-b7ae-eb838defd910 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:15.440425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5726dc-3f9d-4ab4-aef9-d73c9b1ab645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.441067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5726dc-3f9d-4ab4-aef9-d73c9b1ab645 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.441345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5726dc-3f9d-4ab4-aef9-d73c9b1ab645 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.441650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5726dc-3f9d-4ab4-aef9-d73c9b1ab645 None admin] PATH_INFO: `/v3/groups/cd2626f3534d434c838f1c202be3b8a1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.442787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5726dc-3f9d-4ab4-aef9-d73c9b1ab645 None admin] RBAC: Authorizing `identity:get_group(group_id=cd2626f3534d434c838f1c202be3b8a1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:15.444305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5726dc-3f9d-4ab4-aef9-d73c9b1ab645 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:15.445976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 158/327] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/groups/cd2626f3534d434c838f1c202be3b8a1 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:15.446738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5726dc-3f9d-4ab4-aef9-d73c9b1ab645 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:15.454737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:15.496900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:15.554865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ba48c-9651-4c7e-b7ae-eb838defd910 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.571406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5726dc-3f9d-4ab4-aef9-d73c9b1ab645 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.593993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df54b43-aad6-431d-bc5c-6e7b0c428f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.594631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df54b43-aad6-431d-bc5c-6e7b0c428f14 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.594921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df54b43-aad6-431d-bc5c-6e7b0c428f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.595177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df54b43-aad6-431d-bc5c-6e7b0c428f14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.606700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a20464-5f6c-474f-9fee-16ffaaefb479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.607393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a20464-5f6c-474f-9fee-16ffaaefb479 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.607671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a20464-5f6c-474f-9fee-16ffaaefb479 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.607945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a20464-5f6c-474f-9fee-16ffaaefb479 None admin] PATH_INFO: `/v3/groups/cd2626f3534d434c838f1c202be3b8a1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.609340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a20464-5f6c-474f-9fee-16ffaaefb479 None admin] RBAC: Authorizing `identity:get_group(group_id=cd2626f3534d434c838f1c202be3b8a1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:15.610821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a20464-5f6c-474f-9fee-16ffaaefb479 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:15.611229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df54b43-aad6-431d-bc5c-6e7b0c428f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:15.612437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 159/328] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/groups/cd2626f3534d434c838f1c202be3b8a1 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:15.613188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a20464-5f6c-474f-9fee-16ffaaefb479 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5df54b43-aad6-431d-bc5c-6e7b0c428f14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:15.617183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:15.618148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:15.618953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 170/329] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:15.622358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df54b43-aad6-431d-bc5c-6e7b0c428f14 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:15.718047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:15.738339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a20464-5f6c-474f-9fee-16ffaaefb479 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.740761 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df54b43-aad6-431d-bc5c-6e7b0c428f14 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.745554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:15.773925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.774340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.774542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.774792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.774930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.775074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.775206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.775467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.775773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] RBAC: Adding query filter params (group.id=cd2626f3534d434c838f1c202be3b8a1, role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e, scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:15.776074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:15.776169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] RBAC: Adding query filter params (group.id=cd2626f3534d434c838f1c202be3b8a1, role.id=a754d895803642e894fc6ccc699d51d9, scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:15.776476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:15.777531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:15.777921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:15.783236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 171/330] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/role_assignments?group.id=cd2626f3534d434c838f1c202be3b8a1&scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2&role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:15.783449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 160/331] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/role_assignments?group.id=cd2626f3534d434c838f1c202be3b8a1&scope.project.id=a700d82f30b94310b8df3cf9c3ae44c2&role.id=a754d895803642e894fc6ccc699d51d9 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:15.784232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:15.902477 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ed57a-49ce-4e0d-9a1b-9dcaee809cec None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:15.942834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:15.943587 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.943866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.944030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.944723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:15.945023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:15.946491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:15.961315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 172/332] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:15.963096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.076002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922a2a9-9ed2-46c3-b935-99e91d31b2ae None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.110695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4943-9134-47e2-83a7-1199242525d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:16.111300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4943-9134-47e2-83a7-1199242525d8 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.111576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4943-9134-47e2-83a7-1199242525d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.111846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f4943-9134-47e2-83a7-1199242525d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.150676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.179345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f4943-9134-47e2-83a7-1199242525d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:16.180714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f4943-9134-47e2-83a7-1199242525d8 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:16.278697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 161/333] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:16.284692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.289781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.383713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ad77f-67c8-4a70-ae2d-e0fa58a1642b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.415492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36892-01c9-40d6-9b25-4e60925096a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:16.416107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36892-01c9-40d6-9b25-4e60925096a5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.416377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36892-01c9-40d6-9b25-4e60925096a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.416641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c36892-01c9-40d6-9b25-4e60925096a5 None admin] PATH_INFO: `/v3/projects/48f83413dd8d497d98e9b13f0fa4b793` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.417759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c36892-01c9-40d6-9b25-4e60925096a5 None admin] RBAC: Authorizing `identity:get_project(project_id=48f83413dd8d497d98e9b13f0fa4b793)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:16.419199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c36892-01c9-40d6-9b25-4e60925096a5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:16.420797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 173/334] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/projects/48f83413dd8d497d98e9b13f0fa4b793 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:16.426337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4943-9134-47e2-83a7-1199242525d8 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.492359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.522330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f4943-9134-47e2-83a7-1199242525d8 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.553200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c076ac-13fa-4065-b26c-6d4a01cf6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:16.553828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c076ac-13fa-4065-b26c-6d4a01cf6ead None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.554108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c076ac-13fa-4065-b26c-6d4a01cf6ead None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.554376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c076ac-13fa-4065-b26c-6d4a01cf6ead None admin] PATH_INFO: `/v3/groups/999b58ac9a99457189fdfa69f8e0a1f4` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.555445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c076ac-13fa-4065-b26c-6d4a01cf6ead None admin] RBAC: Authorizing `identity:get_group(group_id=999b58ac9a99457189fdfa69f8e0a1f4)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:16.556852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c076ac-13fa-4065-b26c-6d4a01cf6ead None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:16.558410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 162/335] 10.222.0.47 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/groups/999b58ac9a99457189fdfa69f8e0a1f4 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:16.564056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36892-01c9-40d6-9b25-4e60925096a5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.631489 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.660082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c36892-01c9-40d6-9b25-4e60925096a5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.691215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc486-4cbc-4ff2-8036-ed5f485e9db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:16.691805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc486-4cbc-4ff2-8036-ed5f485e9db0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.692074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc486-4cbc-4ff2-8036-ed5f485e9db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.692337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc486-4cbc-4ff2-8036-ed5f485e9db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.693054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc486-4cbc-4ff2-8036-ed5f485e9db0 None admin] RBAC: Adding query filter params (group.id=999b58ac9a99457189fdfa69f8e0a1f4, role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=48f83413dd8d497d98e9b13f0fa4b793) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:16.693885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc486-4cbc-4ff2-8036-ed5f485e9db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:16.695321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc486-4cbc-4ff2-8036-ed5f485e9db0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:16.700846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 174/336] 10.222.0.47 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/role_assignments?group.id=999b58ac9a99457189fdfa69f8e0a1f4&scope.project.id=48f83413dd8d497d98e9b13f0fa4b793&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:19.523726 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c2645-fc23-4547-9b1b-dcd5efb601e3 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.524735 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c2645-fc23-4547-9b1b-dcd5efb601e3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.525226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c2645-fc23-4547-9b1b-dcd5efb601e3 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.527003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 163/337] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:19.532659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cd28e-44a7-4afe-bbf9-1049de534d17 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.533509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cd28e-44a7-4afe-bbf9-1049de534d17 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.533993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cd28e-44a7-4afe-bbf9-1049de534d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.538679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871774db-6f62-4b8a-80b7-d017b186944e None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.539558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871774db-6f62-4b8a-80b7-d017b186944e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.540545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871774db-6f62-4b8a-80b7-d017b186944e None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.543076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 164/338] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:19.549048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462b249-0af6-4adf-b69b-ade2ea38b286 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.549330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462b249-0af6-4adf-b69b-ade2ea38b286 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.549638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462b249-0af6-4adf-b69b-ade2ea38b286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.566340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5a9cd28e-44a7-4afe-bbf9-1049de534d17 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:19.567539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5a9cd28e-44a7-4afe-bbf9-1049de534d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:19.582513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a462b249-0af6-4adf-b69b-ade2ea38b286 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:19.583725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a462b249-0af6-4adf-b69b-ade2ea38b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:19.691116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 175/339] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:19.710791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 165/340] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:19.810145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737d0e9-8d03-40c9-b246-0923a5d6d048 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.810739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737d0e9-8d03-40c9-b246-0923a5d6d048 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.811276 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737d0e9-8d03-40c9-b246-0923a5d6d048 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.812888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 176/341] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:19.818906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c10b-7da7-4d9a-b535-c2e37a18845a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.819187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c10b-7da7-4d9a-b535-c2e37a18845a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.819635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c10b-7da7-4d9a-b535-c2e37a18845a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.846436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f3d4c10b-7da7-4d9a-b535-c2e37a18845a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:19.847861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f3d4c10b-7da7-4d9a-b535-c2e37a18845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:19.912147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec302e-9ace-4169-879a-f4ba4787e6b3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.912764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec302e-9ace-4169-879a-f4ba4787e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.913234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec302e-9ace-4169-879a-f4ba4787e6b3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.915244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 177/342] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:19.920358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaea228-692f-4c8c-8473-bf94805ab958 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.920642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaea228-692f-4c8c-8473-bf94805ab958 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.920912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaea228-692f-4c8c-8473-bf94805ab958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.945922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:19.955707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 166/343] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:19.956616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cdaea228-692f-4c8c-8473-bf94805ab958 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:19.958516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cdaea228-692f-4c8c-8473-bf94805ab958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:20.039505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4c10b-7da7-4d9a-b535-c2e37a18845a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.063543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:20.077623 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 178/344] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:20.078704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaea228-692f-4c8c-8473-bf94805ab958 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.150924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4c10b-7da7-4d9a-b535-c2e37a18845a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.189700 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaea228-692f-4c8c-8473-bf94805ab958 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.193871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.194513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.194791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.195061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.206912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.209114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:20.228035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:20.229033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:20.229949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:20.229949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:20.229949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:20.229949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 167/345] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:20.238383 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.244111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.244943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.245364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.245844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.271449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.272921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.296625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:20.311875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:20.313022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:20.313996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:20.313996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:20.313996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:20.313996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 179/346] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:20.320693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.348312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c4e05-fab8-4bb7-abff-c0c6d1f67e7d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.387084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.387776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.388048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.388313 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.388950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:20.389247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.390634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.403198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 168/347] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:20.403822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.406608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:20.461473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5d7f-13c8-4798-95c3-410d022bdc30 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.495573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.496173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.496446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.496711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.497340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:20.497669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.499032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.513752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 180/348] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:20.513752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.514006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346da3e4-d4c1-46c3-ad31-e5a226843dc9 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.524099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:20.550238 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.550817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.551093 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.551380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.562680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.564188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:20.580690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:20.581659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:20.582508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:20.582508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:20.582508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:20.582508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 169/349] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:20.582733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.632389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93798479-8b29-4094-ab0b-2ff144ef2587 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.644232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:20.670910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cf73e-4b65-4724-854e-70723476eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.671786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf73e-4b65-4724-854e-70723476eece None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.672219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf73e-4b65-4724-854e-70723476eece None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.672477 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf73e-4b65-4724-854e-70723476eece None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.673261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cf73e-4b65-4724-854e-70723476eece None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.674883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cf73e-4b65-4724-854e-70723476eece None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.688310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ae9c7-a6de-4ea9-b392-65f990137df2 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.698663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 181/350] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:20 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:20.700095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cf73e-4b65-4724-854e-70723476eece None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.729507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.730377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.730602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.730871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.749997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.751561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:20.769867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:20.770945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:20.772488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:20.772488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:20.772488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:20.779638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 170/351] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:20.780926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.799682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:20.867540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cf73e-4b65-4724-854e-70723476eece None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.909068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f89771-27de-46a4-8902-9a293c39fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.909733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89771-27de-46a4-8902-9a293c39fbe4 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.909996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89771-27de-46a4-8902-9a293c39fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.910266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89771-27de-46a4-8902-9a293c39fbe4 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.910909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f89771-27de-46a4-8902-9a293c39fbe4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.912557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac82e90-3d90-4afb-a908-03b6decbc51b None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.912975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f89771-27de-46a4-8902-9a293c39fbe4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.935957 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 182/352] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:20 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:20.936479 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f89771-27de-46a4-8902-9a293c39fbe4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.952412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763a98b-b946-4305-a215-634daf27aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.953225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a98b-b946-4305-a215-634daf27aa39 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.954591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a98b-b946-4305-a215-634daf27aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.954591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a98b-b946-4305-a215-634daf27aa39 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.954961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a98b-b946-4305-a215-634daf27aa39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:20.955433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a98b-b946-4305-a215-634daf27aa39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.956852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a98b-b946-4305-a215-634daf27aa39 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.971087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 171/353] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:20.972244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0c012-3e12-455f-b31e-da6e60b951c6 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.972508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0c012-3e12-455f-b31e-da6e60b951c6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.972772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0c012-3e12-455f-b31e-da6e60b951c6 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.974020 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 172/354] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:20.978721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0c012-3e12-455f-b31e-da6e60b951c6 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.993985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:21.074152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f89771-27de-46a4-8902-9a293c39fbe4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:21.080408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:21.115746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0c012-3e12-455f-b31e-da6e60b951c6 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:21.116099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b8132-8ff4-406a-b5fe-08d365eb7626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:21.116741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b8132-8ff4-406a-b5fe-08d365eb7626 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.117020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b8132-8ff4-406a-b5fe-08d365eb7626 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.117290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b8132-8ff4-406a-b5fe-08d365eb7626 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.118137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b8132-8ff4-406a-b5fe-08d365eb7626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:21.118388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b8132-8ff4-406a-b5fe-08d365eb7626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:21.119915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b8132-8ff4-406a-b5fe-08d365eb7626 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:21.133917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 183/355] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:21.135069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9366d5-c4a1-416b-a951-54bbe0530cc4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.135356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9366d5-c4a1-416b-a951-54bbe0530cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.135627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9366d5-c4a1-416b-a951-54bbe0530cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.158757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ed9366d5-c4a1-416b-a951-54bbe0530cc4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:21.160187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c6bb-e9db-42a2-ba6e-2cd1dbdc6cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:21.160351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ed9366d5-c4a1-416b-a951-54bbe0530cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:21.160805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c6bb-e9db-42a2-ba6e-2cd1dbdc6cc6 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.161082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c6bb-e9db-42a2-ba6e-2cd1dbdc6cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.161352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c6bb-e9db-42a2-ba6e-2cd1dbdc6cc6 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.162584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013c6bb-e9db-42a2-ba6e-2cd1dbdc6cc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:21.164300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013c6bb-e9db-42a2-ba6e-2cd1dbdc6cc6 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:21.192662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 173/356] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:20 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:21.194205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c6bb-e9db-42a2-ba6e-2cd1dbdc6cc6 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:21.261626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 184/357] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:21.323318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c6bb-e9db-42a2-ba6e-2cd1dbdc6cc6 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:21.354773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:21.367739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa8acb-4f61-47e4-9f72-1a0db1b10caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:21.368523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8acb-4f61-47e4-9f72-1a0db1b10caa None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.368755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8acb-4f61-47e4-9f72-1a0db1b10caa None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.369032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa8acb-4f61-47e4-9f72-1a0db1b10caa None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.369763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa8acb-4f61-47e4-9f72-1a0db1b10caa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:21.371197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa8acb-4f61-47e4-9f72-1a0db1b10caa None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:21.405536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 174/358] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:21 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:21.539200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9366d5-c4a1-416b-a951-54bbe0530cc4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:21.551540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:21.653415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9366d5-c4a1-416b-a951-54bbe0530cc4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:21.691412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:21.692025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.692351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.692629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.693362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:21.694801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:21.702808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.sql.core [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 12:47:21.702808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 14 12:47:21.702808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [parameters: {'id': '89db2e96b65f48cfa5cb88b1f0d92614', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 14 12:47:21.702808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 14 12:47:21.720289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return ref.to_dict() Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:47:21.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application yield resource Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise self.value Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application session.commit() Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:47:21.722515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:47:21.723357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:47:21.724207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:47:21.725583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [parameters: {'id': '89db2e96b65f48cfa5cb88b1f0d92614', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:21.726391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 14 12:47:21.727208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:21.729457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 185/359] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Oct 14 12:47:21 2022] POST /identity/v3/roles => generated 144 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:21.738681 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa8acb-4f61-47e4-9f72-1a0db1b10caa None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:21.886876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa8acb-4f61-47e4-9f72-1a0db1b10caa None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:21.925323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fef03d-b63a-4cfa-9280-93396d1803ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:21.925906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fef03d-b63a-4cfa-9280-93396d1803ea None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.926183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fef03d-b63a-4cfa-9280-93396d1803ea None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.926454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fef03d-b63a-4cfa-9280-93396d1803ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.941235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fef03d-b63a-4cfa-9280-93396d1803ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-68fef03d-b63a-4cfa-9280-93396d1803ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:21.947175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:21.949355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:21.951359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 175/360] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:21.958986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:22.081931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:22.112032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab05c6-fea4-4183-a665-4d378f6c0863 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:22.148439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d1feb-4853-4710-8cb8-9983e710f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:22.149393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1feb-4853-4710-8cb8-9983e710f82a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.150007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1feb-4853-4710-8cb8-9983e710f82a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.150483 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d1feb-4853-4710-8cb8-9983e710f82a None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.151347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d1feb-4853-4710-8cb8-9983e710f82a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:22.151851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d1feb-4853-4710-8cb8-9983e710f82a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:22.153450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d1feb-4853-4710-8cb8-9983e710f82a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:22.169671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 186/361] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.251579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aef84-ff2d-47ab-b323-f64fc7cc8e27 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.252059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aef84-ff2d-47ab-b323-f64fc7cc8e27 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.252059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aef84-ff2d-47ab-b323-f64fc7cc8e27 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.253362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 176/362] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:23.258529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca31e0-76c9-4722-8318-3c4ec1324f35 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.258927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca31e0-76c9-4722-8318-3c4ec1324f35 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.259098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca31e0-76c9-4722-8318-3c4ec1324f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.277292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c5ca31e0-76c9-4722-8318-3c4ec1324f35 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:23.278496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c5ca31e0-76c9-4722-8318-3c4ec1324f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:23.374626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 187/363] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:23.722192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aef84-ff2d-47ab-b323-f64fc7cc8e27 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.780295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.858166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aef84-ff2d-47ab-b323-f64fc7cc8e27 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.906561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849cbb-aa6a-422e-9218-b10fada77c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.907216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849cbb-aa6a-422e-9218-b10fada77c03 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.907489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849cbb-aa6a-422e-9218-b10fada77c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.907757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849cbb-aa6a-422e-9218-b10fada77c03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.924714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd849cbb-aa6a-422e-9218-b10fada77c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-bd849cbb-aa6a-422e-9218-b10fada77c03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:23.930189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:23.931095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:23.931912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 177/364] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:23.937400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca31e0-76c9-4722-8318-3c4ec1324f35 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.959653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065e5d-40ca-4309-9abb-514456ecf464 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.959942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065e5d-40ca-4309-9abb-514456ecf464 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.960182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065e5d-40ca-4309-9abb-514456ecf464 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.961676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 178/365] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:23.967985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90888-dbda-4ce0-852f-d5ecacf1263d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.968256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90888-dbda-4ce0-852f-d5ecacf1263d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.968523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b90888-dbda-4ce0-852f-d5ecacf1263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.997114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a9b90888-dbda-4ce0-852f-d5ecacf1263d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:23.998372 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a9b90888-dbda-4ce0-852f-d5ecacf1263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:24.042268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.084746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 179/366] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:24.085040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca31e0-76c9-4722-8318-3c4ec1324f35 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.086106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499454e-08f1-4692-901e-313adf7760f3 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.086392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499454e-08f1-4692-901e-313adf7760f3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.086664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499454e-08f1-4692-901e-313adf7760f3 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.089213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 180/367] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:24.100062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7563-0264-402e-8262-d32f61f4013f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.101055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7563-0264-402e-8262-d32f61f4013f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.101503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7563-0264-402e-8262-d32f61f4013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.130010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-e4da7563-0264-402e-8262-d32f61f4013f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:24.132235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e4da7563-0264-402e-8262-d32f61f4013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:24.136203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f138f1-6f09-4562-bb46-06b2de043d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.136892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f138f1-6f09-4562-bb46-06b2de043d0e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.137235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f138f1-6f09-4562-bb46-06b2de043d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.137604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f138f1-6f09-4562-bb46-06b2de043d0e None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.138409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f138f1-6f09-4562-bb46-06b2de043d0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:24.138779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f138f1-6f09-4562-bb46-06b2de043d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.140209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f138f1-6f09-4562-bb46-06b2de043d0e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.148964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 188/368] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:24.154555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9eb2-1e43-4e1f-bd51-ed1f438662a3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.154835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9eb2-1e43-4e1f-bd51-ed1f438662a3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.155107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9eb2-1e43-4e1f-bd51-ed1f438662a3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.160239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 189/369] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:24.160239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da9eb2-1e43-4e1f-bd51-ed1f438662a3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.174377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.239161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 181/370] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:24.241573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a885-41a6-487f-8e48-4ff03ee974a8 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.242077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a885-41a6-487f-8e48-4ff03ee974a8 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.242560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a885-41a6-487f-8e48-4ff03ee974a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.270700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-7044a885-41a6-487f-8e48-4ff03ee974a8 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:24.271994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7044a885-41a6-487f-8e48-4ff03ee974a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:24.304898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da9eb2-1e43-4e1f-bd51-ed1f438662a3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.357452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.370808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.372412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.373007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.373596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.383354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 182/371] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:24.384073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044a885-41a6-487f-8e48-4ff03ee974a8 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.388599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.390279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:24.410434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:24.411353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:24.412217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:24.412217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:24.412217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:24.414252 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 190/372] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:24.426464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.526579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.539581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044a885-41a6-487f-8e48-4ff03ee974a8 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.544676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5839fb0-e026-4f31-bfc0-9b5b1c48191b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.591259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f5f6d-b521-43fb-a126-aa386eadff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.591804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f5f6d-b521-43fb-a126-aa386eadff9a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.592075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f5f6d-b521-43fb-a126-aa386eadff9a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.592340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f5f6d-b521-43fb-a126-aa386eadff9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.597934 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.598797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.599836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.600299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.601140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:24.601688 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.603389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.613611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f5f6d-b521-43fb-a126-aa386eadff9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:24.617659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 191/373] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:24.623134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-077f5f6d-b521-43fb-a126-aa386eadff9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:24.624431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:24.625406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:24.626297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:24.629268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 183/374] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:24.638421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f5f6d-b521-43fb-a126-aa386eadff9a None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.684796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.746058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d516d4-00cf-4cc8-b56a-1e75aecca581 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.761505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f5f6d-b521-43fb-a126-aa386eadff9a None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.780981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.781571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.781850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.782721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.790369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.791822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.796338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.796925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.797196 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.797460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.798167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] RBAC: Adding query filter params (name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:24.798461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.799798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:24.805062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:24.810818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 192/375] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:24.811810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.816110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 184/376] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:24.821755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.842660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.912882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.916605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602aead-5b6c-45ef-b734-5619189c334f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.927283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b114-27cc-4b63-b221-04973299f939 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.951016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551bdd1-6114-4051-a370-b2cfc93845a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.951641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551bdd1-6114-4051-a370-b2cfc93845a4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.951921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551bdd1-6114-4051-a370-b2cfc93845a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.952191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551bdd1-6114-4051-a370-b2cfc93845a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.963245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551bdd1-6114-4051-a370-b2cfc93845a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:24.964142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec271-7c6f-495b-bb49-cd0d7ef51914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.964809 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec271-7c6f-495b-bb49-cd0d7ef51914 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.965087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec271-7c6f-495b-bb49-cd0d7ef51914 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.965354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec271-7c6f-495b-bb49-cd0d7ef51914 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d551bdd1-6114-4051-a370-b2cfc93845a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:24.968606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:24.969512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:24.970334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 193/377] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:24.970994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551bdd1-6114-4051-a370-b2cfc93845a4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.982328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddec271-7c6f-495b-bb49-cd0d7ef51914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-4ddec271-7c6f-495b-bb49-cd0d7ef51914 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:24.988212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:24.989391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 185/378] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:24.990833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec271-7c6f-495b-bb49-cd0d7ef51914 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.078879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.091971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551bdd1-6114-4051-a370-b2cfc93845a4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.104281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec271-7c6f-495b-bb49-cd0d7ef51914 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.125455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.126102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.126373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.126636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.127353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:25.127649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.129079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.138468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.139079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.139348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.139612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.149840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.151273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:25.164922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:25.166011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:25.166851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:25.166851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:25.166851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:25.167018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 194/379] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:25.167018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.167140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 186/380] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:25.167140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.190160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.264672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea6fd5-8620-4f11-9a56-9800c3f2fbdf None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.267695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859589-49ad-460a-bfe3-a16037ab7d6a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.292166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.298454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dccf4-de96-47fb-a22d-09d309a53752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.299118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dccf4-de96-47fb-a22d-09d309a53752 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.299329 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dccf4-de96-47fb-a22d-09d309a53752 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.299599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dccf4-de96-47fb-a22d-09d309a53752 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.300258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dccf4-de96-47fb-a22d-09d309a53752 None admin] RBAC: Adding query filter params (name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:25.300560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dccf4-de96-47fb-a22d-09d309a53752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.301969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dccf4-de96-47fb-a22d-09d309a53752 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.302854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.303451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.303725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.303983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.304626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:25.304922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.306300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.310311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 187/381] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:25.311465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0535bd-6719-4f45-a068-17a0a58e9067 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.311741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0535bd-6719-4f45-a068-17a0a58e9067 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.312007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0535bd-6719-4f45-a068-17a0a58e9067 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.317732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 188/382] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:25.317732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0535bd-6719-4f45-a068-17a0a58e9067 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.318641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 195/383] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:25.319385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.398831 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.416373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0535bd-6719-4f45-a068-17a0a58e9067 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.417691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf51297-d443-484d-8613-a1b3789c668a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.449986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb28811-5730-4ddd-af10-33ff98eb3e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.450572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.450684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28811-5730-4ddd-af10-33ff98eb3e6a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.450861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28811-5730-4ddd-af10-33ff98eb3e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.451129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb28811-5730-4ddd-af10-33ff98eb3e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.451218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.451432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.451701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.452331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:25.452628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.454021 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.460899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb28811-5730-4ddd-af10-33ff98eb3e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.462372 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb28811-5730-4ddd-af10-33ff98eb3e6a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.465948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 196/384] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:25.466537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2bb28811-5730-4ddd-af10-33ff98eb3e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:25.478814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:25.479778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:25.480636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:25.480636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:25.480636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:25.480636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 189/385] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:25.481356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60335c5-6522-48b4-94ef-7cd08bdb26c5 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.481356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60335c5-6522-48b4-94ef-7cd08bdb26c5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.481629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60335c5-6522-48b4-94ef-7cd08bdb26c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.499695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-e60335c5-6522-48b4-94ef-7cd08bdb26c5 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:25.500889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e60335c5-6522-48b4-94ef-7cd08bdb26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:25.539979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.566659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 190/386] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:25.566801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55c15c-bb1a-4191-a2a3-fad3bcb2ddee None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.567444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60335c5-6522-48b4-94ef-7cd08bdb26c5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.608289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.608924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.609449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.610044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.619305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.621473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.623001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:25.638820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:25.639743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:25.640594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:25.640594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:25.640594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:25.640594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 197/387] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:25.640806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.676296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60335c5-6522-48b4-94ef-7cd08bdb26c5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.710220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.710838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.711110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.711392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.721551 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.722981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:25.738253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:25.739182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:25.740599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:25.740599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:25.740599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:25.740599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 191/388] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:25.740599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.758185 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c451c5-dcb8-47e6-8179-7daefc19897f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.770271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.799436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.800060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.800400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.800593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.807521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.808966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:25.820459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:25.821364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:25.822896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 198/389] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:25.826785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.851555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8536-171b-4156-bcaa-13e3da73ed60 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.879618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.885373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.885997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.886276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.886544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.887182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:25.887484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.888853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.900802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 192/390] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:25.901632 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.930781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ee587-e568-49d2-8c78-3f89fea0c09e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.965061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.965694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.965971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.966239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.966873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:25.967174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.968574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.982106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 199/391] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:25.982961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.988848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.004665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ff3b-42db-4e45-8cef-dafd0fde0cd7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.039100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.039721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.039997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.040265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.040896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:26.041193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.042588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.053306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 193/392] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.055200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.081596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00c83-99f0-4f43-810a-75da8f6f33a5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.094669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.116912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.117528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.117806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.118072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.118787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:26.119087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.120543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.137784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 200/393] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.138576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.158652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beb6b2-e4e0-4952-8469-0099e8bca9e6 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.191500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.192050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.192320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.192585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.203340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.204773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.211593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:26.219995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:26.221028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:26.221903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:26.221903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:26.221903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:26.221903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 194/394] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:26.222565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.236930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d46cc-3564-4d26-bb46-d96f4a2fa6ec None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.270368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.271071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.271893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.272163 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.278681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.280110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:26.291662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:26.292618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:26.293472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:26.293472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:26.293472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:26.293472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:26.293472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:26.293472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:26.293472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:26.293472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:26.297367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 201/395] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:26.298169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.319022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea9de-3919-4313-8d22-ccdd5730aaad None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.329009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.351613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.352221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.352492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.352759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.360183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.361638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:26.373869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:26.374801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 195/396] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:26.375798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.400570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e97d6d-0ab3-41fb-838d-b5e55304384d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.432102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.432718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.432987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.433252 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.435269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.440598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.442124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:26.453404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:26.454365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:26.455629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 202/397] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:26.457053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.478493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8440990-44d8-487b-a0be-2ed06c502a97 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.511267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.511880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.512152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.512416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.522979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.524418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:26.538290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:26.539207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:26.540141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:26.540141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:26.540141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:26.540141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 196/398] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:26.540141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.550583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.560865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0544f-cd2e-4abc-8ddd-55febe33bd50 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.600149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.600754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.601033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.601309 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.601979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:26.602285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.603662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.615827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 203/399] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.616601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.644233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf438e8-935b-40f4-8416-835d011b07d8 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.654340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.678123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.678722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.679000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.679268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.679962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:26.680268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.681743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.699333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 197/400] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.700056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.714987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c9171-5b66-4612-a733-5c9cf36ce004 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.748649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.749240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.749537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.749807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.750523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:26.750822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.752230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.771165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 204/401] 10.222.0.47 () {56 vars in 1139 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.771165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.783412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.799126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b916755-7a39-4b0c-a8dc-a97f33190d59 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.832321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.832915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.833196 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.833509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.834260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:26.834564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.836001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.870494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c01f32-74fc-4b81-9c22-9742d9dad457 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.872323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 198/402] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.873107 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.899543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.908211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.908813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.909088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.909358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.910044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:26.910332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.912218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.923168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 205/403] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.923914 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.973783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5de27d-f6f7-4a05-9fde-2e8523da5f2f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.990550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.013437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fd91d-abeb-4298-bed9-f4e15301758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.014082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fd91d-abeb-4298-bed9-f4e15301758a None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.014358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fd91d-abeb-4298-bed9-f4e15301758a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.014625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fd91d-abeb-4298-bed9-f4e15301758a None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.015266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fd91d-abeb-4298-bed9-f4e15301758a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.016704 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2fd91d-abeb-4298-bed9-f4e15301758a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.022975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77644151-b45f-4c2e-a2cb-3b7614d7bde2 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.038642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 199/404] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:26 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:27.039616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fd91d-abeb-4298-bed9-f4e15301758a None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.066916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db66ce-942e-4170-a362-b340bf5890b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.068106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db66ce-942e-4170-a362-b340bf5890b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.068479 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db66ce-942e-4170-a362-b340bf5890b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.068850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db66ce-942e-4170-a362-b340bf5890b0 None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/d360b800645041cf8caa43dcc0116761/roles/df5e47546621472692145fb33dc3d1a2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.090865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db66ce-942e-4170-a362-b340bf5890b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=d360b800645041cf8caa43dcc0116761, role_id=df5e47546621472692145fb33dc3d1a2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.093209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db66ce-942e-4170-a362-b340bf5890b0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.110098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 206/405] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:26 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/d360b800645041cf8caa43dcc0116761/roles/df5e47546621472692145fb33dc3d1a2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:27.110961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db66ce-942e-4170-a362-b340bf5890b0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.152027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.173357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fd91d-abeb-4298-bed9-f4e15301758a None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.218039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.218745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.219027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.219295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.231903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.233375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:27.251287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:27.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:27.253637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:27.253637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:27.253637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:27.253637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 200/406] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:27.253637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.272940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db66ce-942e-4170-a362-b340bf5890b0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.297436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.323906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.324924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.325382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.325973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.342371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.344131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:27.361809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:27.362775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:27.363633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:27.363633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:27.363633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:27.363633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 207/407] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:27.364348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.389326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b53e-e2b6-46c3-ae27-98b9523fd01c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.431483 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.432176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.432515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.432789 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.436147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.441424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.443511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:27.456180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:27.457143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:27.458192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 201/408] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:27.460097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.499143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b5d5-57b6-419d-9769-987dc932a8d6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.538929 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.539727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.540698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.541075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.542328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:27.542744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.545472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.561601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 208/409] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:27.563509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.585385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42b6ae-778f-4b31-885e-7fbcfe6eee01 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.603707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.638019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.639501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.640015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.640443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.641496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:27.641834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.643284 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.657783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 202/410] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:27.658618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.695724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3229e-2b77-474c-942a-f23a6ce6fa50 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.731852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.734245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.734908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.735226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.735592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.736366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:27.736602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.738077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.761748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 209/411] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:27.762609 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.786068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69fc44-0106-42de-adca-ce1875c31ce9 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.829220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.830269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.830743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.831243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.842611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.844873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.860504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:27.861945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:27.862802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:27.863657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:27.863657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:27.863657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:27.863657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:27.863657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:27.863657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:27.863657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:27.863657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:27.869883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 203/412] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:27.869883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.877114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3850884-1852-4a6f-b5d4-b3b6d27646fd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.913541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.914123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.914447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.914718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.921847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.923366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:27.935180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:27.936060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:27.936904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 210/413] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:27.937360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:28.004286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001dc5f-90f1-4f08-b042-963af92ac990 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:28.023535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:28.045900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06721b-94c2-4af5-b889-ee3c29ae298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:28.046582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06721b-94c2-4af5-b889-ee3c29ae298f None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:28.046854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06721b-94c2-4af5-b889-ee3c29ae298f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:28.047122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06721b-94c2-4af5-b889-ee3c29ae298f None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/3697284166c042d79d946ef469932562/roles/df5e47546621472692145fb33dc3d1a2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:28.065101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06721b-94c2-4af5-b889-ee3c29ae298f None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=3697284166c042d79d946ef469932562, role_id=df5e47546621472692145fb33dc3d1a2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:28.066721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06721b-94c2-4af5-b889-ee3c29ae298f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:28.087345 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4aff-446d-46ba-b9ff-1c226719a2b5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:28.089714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 204/414] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:27 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/3697284166c042d79d946ef469932562/roles/df5e47546621472692145fb33dc3d1a2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:28.091283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06721b-94c2-4af5-b889-ee3c29ae298f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:28.126399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:28.127374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:28.127850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:28.128380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:28.129534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:28.130056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:28.132282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:28.145677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 211/415] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:28.151861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:28.165930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:28.211465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06721b-94c2-4af5-b889-ee3c29ae298f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:28.251562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:28.252203 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:28.252474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:28.252739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:28.253698 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:28.253894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:28.255385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:28.266819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a418e26-9781-4667-8bb7-1b9bdd491546 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:28.267957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 205/416] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:28.274530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:28.305334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:28.307250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c95ec-7601-4111-a64d-3fad4bd2cdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:28.308167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c95ec-7601-4111-a64d-3fad4bd2cdc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:28.308634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c95ec-7601-4111-a64d-3fad4bd2cdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:28.309066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c95ec-7601-4111-a64d-3fad4bd2cdc2 None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/899319384b8b471f8d308f37be459c59/roles/df5e47546621472692145fb33dc3d1a2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:28.326999 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c95ec-7601-4111-a64d-3fad4bd2cdc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=899319384b8b471f8d308f37be459c59, role_id=df5e47546621472692145fb33dc3d1a2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:28.328859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c95ec-7601-4111-a64d-3fad4bd2cdc2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:28.348473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 212/417] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:28 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/899319384b8b471f8d308f37be459c59/roles/df5e47546621472692145fb33dc3d1a2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:28.402150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf078fd-77b7-4db8-b19a-39e4f5ce2901 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:28.443935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8069e8-21dc-4011-be83-e9811990ebf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:28.444782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8069e8-21dc-4011-be83-e9811990ebf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:28.445123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8069e8-21dc-4011-be83-e9811990ebf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:28.445397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8069e8-21dc-4011-be83-e9811990ebf5 None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/99e3385f7c3948f9ab871233626c3257/roles/df5e47546621472692145fb33dc3d1a2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:28.464778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8069e8-21dc-4011-be83-e9811990ebf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=99e3385f7c3948f9ab871233626c3257, role_id=df5e47546621472692145fb33dc3d1a2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:28.466639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8069e8-21dc-4011-be83-e9811990ebf5 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:28.484715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 206/418] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:28 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/99e3385f7c3948f9ab871233626c3257/roles/df5e47546621472692145fb33dc3d1a2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:29.543115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c5c6-3311-4667-a07b-454b0fb7d608 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.543633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c5c6-3311-4667-a07b-454b0fb7d608 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.543633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c5c6-3311-4667-a07b-454b0fb7d608 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.545226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 213/419] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:29.551271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716453-8d42-4b35-b51f-a3d137976a58 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.551782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716453-8d42-4b35-b51f-a3d137976a58 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.551782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c716453-8d42-4b35-b51f-a3d137976a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.574715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0c716453-8d42-4b35-b51f-a3d137976a58 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:29.575904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0c716453-8d42-4b35-b51f-a3d137976a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:29.670966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 207/420] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:29.676287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606043e1-973d-49cd-a7cc-0bffaf73e044 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.676569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606043e1-973d-49cd-a7cc-0bffaf73e044 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.676839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606043e1-973d-49cd-a7cc-0bffaf73e044 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.678720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 214/421] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:29.683784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c81a8-4b3b-4667-91c9-7994f1fd4717 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.684071 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c81a8-4b3b-4667-91c9-7994f1fd4717 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.684347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c81a8-4b3b-4667-91c9-7994f1fd4717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.702716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:29.711142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-e45c81a8-4b3b-4667-91c9-7994f1fd4717 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:29.712674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e45c81a8-4b3b-4667-91c9-7994f1fd4717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:29.795764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 208/422] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:30.107070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606043e1-973d-49cd-a7cc-0bffaf73e044 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.150626 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c81a8-4b3b-4667-91c9-7994f1fd4717 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.179536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.259197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606043e1-973d-49cd-a7cc-0bffaf73e044 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.298682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c81a8-4b3b-4667-91c9-7994f1fd4717 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.335206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f128a-a566-4085-8447-c934b6d42443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.336215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f128a-a566-4085-8447-c934b6d42443 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.336686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f128a-a566-4085-8447-c934b6d42443 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.337171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f128a-a566-4085-8447-c934b6d42443 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.339510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24410e8-e42c-40c7-abc9-9073dd4e0509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.340149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24410e8-e42c-40c7-abc9-9073dd4e0509 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.340422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24410e8-e42c-40c7-abc9-9073dd4e0509 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.340684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24410e8-e42c-40c7-abc9-9073dd4e0509 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.341013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.350173 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f128a-a566-4085-8447-c934b6d42443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-290f128a-a566-4085-8447-c934b6d42443 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:30.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:30.356247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:30.357130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:30.359993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 209/423] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:30.366002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f128a-a566-4085-8447-c934b6d42443 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.374461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24410e8-e42c-40c7-abc9-9073dd4e0509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-b24410e8-e42c-40c7-abc9-9073dd4e0509 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:30.379287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:30.381572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:30.383800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:30.385833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 215/424] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:30.393122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24410e8-e42c-40c7-abc9-9073dd4e0509 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.483299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f128a-a566-4085-8447-c934b6d42443 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.523833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.524846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.525319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.525803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.526747 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] RBAC: Adding query filter params (name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:30.527262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.528836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.538317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 210/425] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:30.543649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.634080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24410e8-e42c-40c7-abc9-9073dd4e0509 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.658912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.669925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.698621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.701096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.701605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.702156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.704168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:30.706196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.707785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.724753 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 216/426] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:30.730212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.748255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236c8a-d21c-41fb-9f8a-b9c0fb5aba23 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.824254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.824895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.825166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.825601 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.850080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.851615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:30.880650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:30.881694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:30.882547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:30.882547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:30.882547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:30.882547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 211/427] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:30.892354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.930386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234472a-8664-4b56-b06b-641fcd5a480c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.990347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa3ea5-4d62-4211-a3e0-f07a310bd6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.990988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa3ea5-4d62-4211-a3e0-f07a310bd6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.991263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa3ea5-4d62-4211-a3e0-f07a310bd6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.991776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa3ea5-4d62-4211-a3e0-f07a310bd6a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.008637 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa3ea5-4d62-4211-a3e0-f07a310bd6a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:31.010246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa3ea5-4d62-4211-a3e0-f07a310bd6a5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-00fa3ea5-4d62-4211-a3e0-f07a310bd6a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:31.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:31.030467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:31.031515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:31.031515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:31.031515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:31.031515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 217/428] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:31.037075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24e388-9d40-45cd-a674-61f99b8f56b6 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.037075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24e388-9d40-45cd-a674-61f99b8f56b6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.037075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24e388-9d40-45cd-a674-61f99b8f56b6 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.037075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 218/429] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:31.037075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5f2e-d8c3-475b-ba54-6fcc5c62e196 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.037075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5f2e-d8c3-475b-ba54-6fcc5c62e196 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.037594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a5f2e-d8c3-475b-ba54-6fcc5c62e196 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.037847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 219/430] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:31.038470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a5f2e-d8c3-475b-ba54-6fcc5c62e196 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.054201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4d224-2b93-4fb8-9728-6fd12b1fb082 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.065245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:31.083813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:31.089696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692f7ce-b45d-4a75-9189-8a907d087b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.090297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692f7ce-b45d-4a75-9189-8a907d087b54 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.090569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692f7ce-b45d-4a75-9189-8a907d087b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.090893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692f7ce-b45d-4a75-9189-8a907d087b54 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.091533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692f7ce-b45d-4a75-9189-8a907d087b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:31.091857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692f7ce-b45d-4a75-9189-8a907d087b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:31.093199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692f7ce-b45d-4a75-9189-8a907d087b54 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:31.107602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 212/431] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:31.109330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2f3df-92ea-4d1e-a5d4-04798e3a549f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.109461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2f3df-92ea-4d1e-a5d4-04798e3a549f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.109698 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2f3df-92ea-4d1e-a5d4-04798e3a549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.129262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-63a2f3df-92ea-4d1e-a5d4-04798e3a549f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:31.130540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-63a2f3df-92ea-4d1e-a5d4-04798e3a549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:31.159079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a5f2e-d8c3-475b-ba54-6fcc5c62e196 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.192377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.193006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.193283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.193580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.194223 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:31.194526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:31.195891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:31.196285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 213/432] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:31.203196 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a6bb4-ab68-4419-9655-12b4542ac744 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.203480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a6bb4-ab68-4419-9655-12b4542ac744 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.203750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a6bb4-ab68-4419-9655-12b4542ac744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.211979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 220/433] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:31.211979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.227519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c35a6bb4-ab68-4419-9655-12b4542ac744 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:31.228996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c35a6bb4-ab68-4419-9655-12b4542ac744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:31.303555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 214/434] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:31.305225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dc2c6-6f49-49d1-a377-d5a51e945747 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.305813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dc2c6-6f49-49d1-a377-d5a51e945747 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.306091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dc2c6-6f49-49d1-a377-d5a51e945747 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.311352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 215/435] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:31.311352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dc2c6-6f49-49d1-a377-d5a51e945747 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.316888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:31.327012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0541e-f13e-41ad-9c75-056c61f94210 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.348016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:31.375153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db0090-4873-4da4-ac70-f0e3d28fde38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.376088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0090-4873-4da4-ac70-f0e3d28fde38 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.377045 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0090-4873-4da4-ac70-f0e3d28fde38 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.377550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0090-4873-4da4-ac70-f0e3d28fde38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.389231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db0090-4873-4da4-ac70-f0e3d28fde38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:31.390812 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db0090-4873-4da4-ac70-f0e3d28fde38 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-23db0090-4873-4da4-ac70-f0e3d28fde38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:31.402727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:31.403648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:31.404549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 221/436] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:31.405137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fdfe1-dade-42be-9249-cd3e85125b4c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.405734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fdfe1-dade-42be-9249-cd3e85125b4c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.405734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fdfe1-dade-42be-9249-cd3e85125b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.423521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-153fdfe1-dade-42be-9249-cd3e85125b4c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:31.424647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-153fdfe1-dade-42be-9249-cd3e85125b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:31.442037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dc2c6-6f49-49d1-a377-d5a51e945747 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.490888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.491651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.492046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.492407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] PATH_INFO: `/v3/users/swift` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.493063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 222/437] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:31.493928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fdfe1-dade-42be-9249-cd3e85125b4c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.511399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:31.512981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:31.528131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:31.529049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:31.530003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 216/438] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:31.530647 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.590941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:31.608774 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fdfe1-dade-42be-9249-cd3e85125b4c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.634970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:31.646316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b07a-26a6-4e49-b914-da5dfc695eea None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.646617 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.647225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.647497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.647765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.648484 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:31.648784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:31.650229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:31.667512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 223/439] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:31.668303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.690840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4a68-46e9-43f9-a6fc-3fda64bb9933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.691395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4a68-46e9-43f9-a6fc-3fda64bb9933 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.691906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4a68-46e9-43f9-a6fc-3fda64bb9933 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.691906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4a68-46e9-43f9-a6fc-3fda64bb9933 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.702823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd4a68-46e9-43f9-a6fc-3fda64bb9933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-f8bd4a68-46e9-43f9-a6fc-3fda64bb9933 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:31.707998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:31.708947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 217/440] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:31.710376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4a68-46e9-43f9-a6fc-3fda64bb9933 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.773841 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b5e8-3ab7-431a-8351-0fc0a500d7fa None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.808474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.809075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.809351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.809655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.810378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:31.810685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:31.812119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:31.813507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4a68-46e9-43f9-a6fc-3fda64bb9933 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.826631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:31.833865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 224/441] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:31.835051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.847274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ac555-6ea5-42d9-adde-fb3850523ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ac555-6ea5-42d9-adde-fb3850523ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.848174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ac555-6ea5-42d9-adde-fb3850523ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.848443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ac555-6ea5-42d9-adde-fb3850523ec2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:31.858718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ac555-6ea5-42d9-adde-fb3850523ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-363ac555-6ea5-42d9-adde-fb3850523ec2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:31.864146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:31.865254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:31.866293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 218/442] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:31.870713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ac555-6ea5-42d9-adde-fb3850523ec2 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:31.883152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:31.935454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd902d64-bd23-43e7-8ec3-c77b4a123018 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.967967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac82e-d112-429c-be62-560fb21abb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:31.968500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac82e-d112-429c-be62-560fb21abb29 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:31.968775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac82e-d112-429c-be62-560fb21abb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:31.969016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ac555-6ea5-42d9-adde-fb3850523ec2 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:31.969116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac82e-d112-429c-be62-560fb21abb29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.004269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.004867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.005145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.005407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.006095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] RBAC: Adding query filter params (name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:32.006396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.008028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.015304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 219/443] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:32.016059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.038158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.040488 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ac82e-d112-429c-be62-560fb21abb29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.042351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ac82e-d112-429c-be62-560fb21abb29 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.084274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.115295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae187cd7-543a-4303-8eae-02c61559edab None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.143599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 225/444] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:32.144412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac82e-d112-429c-be62-560fb21abb29 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.153652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9996e-3b8b-4ef8-91b7-be2cfb24fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.154312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9996e-3b8b-4ef8-91b7-be2cfb24fafa None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.154586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9996e-3b8b-4ef8-91b7-be2cfb24fafa None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.154861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9996e-3b8b-4ef8-91b7-be2cfb24fafa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.164799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9996e-3b8b-4ef8-91b7-be2cfb24fafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-19d9996e-3b8b-4ef8-91b7-be2cfb24fafa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:32.170907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:32.171833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 220/445] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:32.172883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9996e-3b8b-4ef8-91b7-be2cfb24fafa None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.241286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.244384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac82e-d112-429c-be62-560fb21abb29 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.270456 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9996e-3b8b-4ef8-91b7-be2cfb24fafa None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.278559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.279184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.279458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.279724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.289971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.291427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.298805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.304032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.304628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.304906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.305178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.305868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] RBAC: Adding query filter params (name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:32.306070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:32.307159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:32.307990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:32.307990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.307990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:32.308158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.308225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 226/446] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:32.308289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.308359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.319406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 221/447] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:32.320276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.418580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205058-90ef-438f-a970-3109619a1bd0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.419570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742077-3bb5-4fa8-9ac1-5b532d01afad None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.452373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.452672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.452995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.453274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.453361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.453580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.453684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.453952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.464318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.464836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.465805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.466297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:32.480237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:32.481305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:32.485363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:32.485363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.485363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:32.485588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:32.486495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:32.487494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:32.487494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.487494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:32.487696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 227/449] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:32.487773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 222/449] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:32.487773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.487913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.490516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.532311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.584599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e94f9-513f-4cdc-b388-8ca594b8df8d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.587973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c947f-b569-4a0b-bf42-6556331429f5 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.617528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.618131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.618410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.618681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.619344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:32.619646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.621010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.622931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.623636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.623960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.624244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.624914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:32.625214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.626656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.629369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 228/450] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:32.630243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.639234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 223/451] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:32.640029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.694925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.730866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848047-4b9f-43ac-af0c-e29088b1ddc6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.743089 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ea9d8-1920-4ada-96fb-96e61f0f5fab None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.750319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.763965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.764266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.764544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.764811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.775524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.776988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.779236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.780007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.780278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.780545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.781183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:32.781501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.782913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:32.791443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:32.792390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:32.798441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:32.798441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.798441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:32.798441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 229/452] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:32.798441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.798752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 224/453] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:32.798752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.894667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f4b95-8cdd-47a9-948a-73884e547124 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.897080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d3d51-dbb5-4ace-aa6e-9cf88b991f14 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:32.911792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:32.929219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.929832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.930144 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.930451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.930637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:32.931118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:32.931280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.931454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.931556 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.931807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.932852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.942210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:32.944199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:32.945096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 230/454] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:32.945904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:32.959490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:32.960624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:32.961784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:32.961784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:32.961784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:32.961784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 225/455] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:32.961784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:32.983491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.048987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5664-29c3-4153-b767-4144a00f272f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.062749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87877ea-2bb3-4756-b165-629509c33cb4 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.082732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.083935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.084214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.084482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.091161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.092618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.097141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.097766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.098037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.098310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.099012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:33.099319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.100668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:33.103898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:33.104885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 231/456] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:33.110857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.112245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 226/457] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:33.113259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.147429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.190738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.205709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325530-e14d-43de-b6e9-cf509fe6890b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.213180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cbe12-aaa2-4bd9-b9b8-2ba62fdfa005 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.239161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.239870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.240146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.240415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.246692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.247302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.247523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.247616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.247824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.248960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.254336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.255740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:33.260199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:33.261278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 232/458] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:33.262461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:33.270449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:33.271984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:33.273066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:33.273066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:33.273066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:33.273066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:33.273066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:33.273066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:33.273066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:33.273066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:33.278545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 227/459] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:33.278545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.360341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.363882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66d7a2-ab98-41f4-8465-ebf99909d9d5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.372258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be3d32-751c-4045-98ae-324f16c8e4df None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.397996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.398595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.398869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.399142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.399774 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:33.400076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.401437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.405507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.406106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.406378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.406645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.407327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:33.407629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.409038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.412909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 233/460] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:33.413719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.416016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.423015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 228/461] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:33.423795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.509381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87637c94-b44a-4f77-a1eb-4ae9ffdd00fd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.520204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cfcef-21d5-428c-a84b-cf9ea089270a None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.541602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.542215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.542487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.542749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.549344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.550813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.554782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.555373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.555648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.555921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.556646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:33.556955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.558401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:33.562481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:33.563347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 234/462] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:33.564330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.583750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 229/463] 10.222.0.47 () {56 vars in 1139 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:33.583750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.585712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.638024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.662346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56944bb-2d55-4d31-a16a-7e9b03c61d8a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.679760 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fc384-06ee-4e11-8c58-9323dc8e6928 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.694268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.694863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.695134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.695652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.696060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:33.696358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.697805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.709274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 235/464] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:33.710046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.712846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.714108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.714386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.714652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.721591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.722994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:33.735002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:33.735884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 230/465] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:33.736769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.790321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.812679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8791ea-411a-46e7-b52e-710b4d40dde5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.833733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267d2d7-a977-46eb-80b9-d1420ad124a6 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.845122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea2548-3685-47e2-aa2d-6ede3c05fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.845813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea2548-3685-47e2-aa2d-6ede3c05fb4f None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.846092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea2548-3685-47e2-aa2d-6ede3c05fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.846360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea2548-3685-47e2-aa2d-6ede3c05fb4f None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/6d66e92ebdd94630b887b31470be78ab/roles/df5e47546621472692145fb33dc3d1a2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.849754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.861969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea2548-3685-47e2-aa2d-6ede3c05fb4f None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=6d66e92ebdd94630b887b31470be78ab, role_id=df5e47546621472692145fb33dc3d1a2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.863420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea2548-3685-47e2-aa2d-6ede3c05fb4f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.868684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.869292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.869600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.869866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.870599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:33.870958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.872815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.875935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 236/466] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:33 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/6d66e92ebdd94630b887b31470be78ab/roles/df5e47546621472692145fb33dc3d1a2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:33.876716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea2548-3685-47e2-aa2d-6ede3c05fb4f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.891597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 231/467] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:33.892270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.007002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141ea3-f140-463b-b506-66180856e3c5 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.007480 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea2548-3685-47e2-aa2d-6ede3c05fb4f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.040789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.045970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.046548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.046882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.047091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.048650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] RBAC: Adding query filter params (role.id=df5e47546621472692145fb33dc3d1a2, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=d360b800645041cf8caa43dcc0116761) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:34.048763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.050308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eccab-35ff-446c-9845-7b85923e56a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.050432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.050506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eccab-35ff-446c-9845-7b85923e56a4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.050506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eccab-35ff-446c-9845-7b85923e56a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.050751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eccab-35ff-446c-9845-7b85923e56a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.058228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 232/468] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/role_assignments?user.id=d360b800645041cf8caa43dcc0116761&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=df5e47546621472692145fb33dc3d1a2 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.058228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.124463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.137068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eccab-35ff-446c-9845-7b85923e56a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.139066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eccab-35ff-446c-9845-7b85923e56a4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.204509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703915-a59d-49ec-8356-6ef96f8566cf None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.253298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.254385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.254663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.254934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.255722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:34.256029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.257475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.271982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 237/469] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:34.273079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eccab-35ff-446c-9845-7b85923e56a4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.278674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 233/470] 10.222.0.47 () {56 vars in 1137 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.279279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.316446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.397452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.403685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f1def-7d51-4764-bbed-e044ee95b948 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.407325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eccab-35ff-446c-9845-7b85923e56a4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.440888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.441540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.441826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.442086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.453720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.455282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.457106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c445de-a03f-4fc1-99cf-90abc822ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.458924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c445de-a03f-4fc1-99cf-90abc822ab06 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.459403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c445de-a03f-4fc1-99cf-90abc822ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.459858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c445de-a03f-4fc1-99cf-90abc822ab06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:34.472058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:34.472969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:34.473898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:34.473898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:34.473898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:34.479917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 234/471] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:34.479917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.548014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c445de-a03f-4fc1-99cf-90abc822ab06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.549868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c445de-a03f-4fc1-99cf-90abc822ab06 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.586462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.602699 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d609099-e37e-4c47-b226-2e41acc64f31 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.641294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5440910-8870-417d-8ccd-f6b84e875c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.642476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5440910-8870-417d-8ccd-f6b84e875c5d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.643028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5440910-8870-417d-8ccd-f6b84e875c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.643492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5440910-8870-417d-8ccd-f6b84e875c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.673922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.681846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 238/472] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:34.682786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c445de-a03f-4fc1-99cf-90abc822ab06 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.717540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5440910-8870-417d-8ccd-f6b84e875c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.719530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5440910-8870-417d-8ccd-f6b84e875c5d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.801752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c445de-a03f-4fc1-99cf-90abc822ab06 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.839916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.847780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 235/473] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:34.848655 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5440910-8870-417d-8ccd-f6b84e875c5d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.849876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.850499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.850777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.851160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.851911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:34.852224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.853645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.868499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 239/474] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.869557 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.900558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.952686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5440910-8870-417d-8ccd-f6b84e875c5d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.986719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.987446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.987790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.988126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.988906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5763-6da7-4974-89e9-b5cf2a71440f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.000422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.001996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:35.016914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:35.017862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:35.018710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:35.018710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:35.018710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:35.018710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 236/475] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:35.018920 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.025808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.026547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.026933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.027258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.039065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.040721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:35.058033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:35.060256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:35.062323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:35.062323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:35.062323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:35.062323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 240/476] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:35.062323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.107165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.126539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.129602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f3aa-687b-4e8a-b82c-7dd16585e6b0 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.164073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.164804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.165144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.165503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.172498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.173115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420870fa-0f31-4f84-974a-61a7adf94272 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.174140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:35.185976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:35.188191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 237/477] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:35.190281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.210484 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.211101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.211377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.211648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.212295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:35.212595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.214125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.228122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 241/478] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.229007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.298607 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4937b9-920f-4ac3-889c-9abfbc7d04fe None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.333288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.334034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.334376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.334714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.335425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:35.335795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.337227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.337382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.341932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0345-a03b-4076-a8a2-54f6bcbfc3b8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.350570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 238/479] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.351672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.374035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.383332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.384429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.384715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.385134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.385981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:35.386292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.388009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.404599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 242/480] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.405583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.459179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb21f4-e5b2-4d21-9c73-acb9f6468224 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.495460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.496174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.496570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.496938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.504106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.505804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:35.517522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:35.518912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:35.521431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 239/481] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:35.525780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.537499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f21dde-ed35-4b0f-8236-a9a439e58a7a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.585331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.586155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.586436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.586975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.596771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.598529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.611464 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:35.617355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:35.618401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:35.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:35.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:35.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:35.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:35.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:35.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:35.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:35.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:35.621719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 243/482] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:35.622880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.635808 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60f3f-8532-4c60-a2f2-76730f356f46 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.653646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.673270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.673904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.674180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.674445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.675171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] RBAC: Adding query filter params (role.id=df5e47546621472692145fb33dc3d1a2, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=899319384b8b471f8d308f37be459c59) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:35.675476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.677416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.684295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 240/483] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/role_assignments?user.id=899319384b8b471f8d308f37be459c59&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=df5e47546621472692145fb33dc3d1a2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.685221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.749727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790a2e3-5ff8-4ea0-a238-aef0f4b0a6eb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.790054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.791060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.791647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.792140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.793112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:35.793658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.795400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.816432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 244/484] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.823630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.894582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4d475-7237-4541-a743-9d04eea82307 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.940173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.941620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.942646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.942999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.943310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.944558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:35.944866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.946978 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.964515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41421677-72cf-4fa9-9642-6deb62cc9c0d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.965306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 241/485] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.971230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.981939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:36.012291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fb7a1-861e-4f7f-87ab-7a7314abea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:36.013263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb7a1-861e-4f7f-87ab-7a7314abea5a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:36.013833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb7a1-861e-4f7f-87ab-7a7314abea5a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:36.014309 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb7a1-861e-4f7f-87ab-7a7314abea5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:36.015270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fb7a1-861e-4f7f-87ab-7a7314abea5a None admin] RBAC: Adding query filter params (role.id=df5e47546621472692145fb33dc3d1a2, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=3697284166c042d79d946ef469932562) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:36.015868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fb7a1-861e-4f7f-87ab-7a7314abea5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:36.017709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fb7a1-861e-4f7f-87ab-7a7314abea5a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:36.024485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 245/486] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/role_assignments?user.id=3697284166c042d79d946ef469932562&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=df5e47546621472692145fb33dc3d1a2 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:36.098316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f78e81-b8df-49d9-b410-8fcf5a68f27c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:36.141167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24aba5-1190-4fe7-95c8-60e467a95446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:36.141788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24aba5-1190-4fe7-95c8-60e467a95446 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:36.142063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24aba5-1190-4fe7-95c8-60e467a95446 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:36.142333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24aba5-1190-4fe7-95c8-60e467a95446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:36.143082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24aba5-1190-4fe7-95c8-60e467a95446 None admin] RBAC: Adding query filter params (role.id=df5e47546621472692145fb33dc3d1a2, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=99e3385f7c3948f9ab871233626c3257) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:36.143389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24aba5-1190-4fe7-95c8-60e467a95446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:36.144929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24aba5-1190-4fe7-95c8-60e467a95446 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:36.154770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 242/487] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/role_assignments?user.id=99e3385f7c3948f9ab871233626c3257&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=df5e47546621472692145fb33dc3d1a2 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:36.264693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bdeb8-46b7-45f7-8fa4-9061436d2c45 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:36.265021 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bdeb8-46b7-45f7-8fa4-9061436d2c45 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:36.265240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bdeb8-46b7-45f7-8fa4-9061436d2c45 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:36.267067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 246/488] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:36.282921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53ba1-1c0c-4e06-b697-e1de3a4d8c5d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:36.283287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53ba1-1c0c-4e06-b697-e1de3a4d8c5d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:36.283451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db53ba1-1c0c-4e06-b697-e1de3a4d8c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:36.307859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9db53ba1-1c0c-4e06-b697-e1de3a4d8c5d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:36.309105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9db53ba1-1c0c-4e06-b697-e1de3a4d8c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:36.447525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:36.467621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 243/489] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:36.565780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609891-e088-4866-a555-501d99ca76da None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:36.566125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609891-e088-4866-a555-501d99ca76da None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:36.566335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609891-e088-4866-a555-501d99ca76da None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:36.567903 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 247/490] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:36.573145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eea164-1eac-4f4b-9be2-fac3894b40ee None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:36.573450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eea164-1eac-4f4b-9be2-fac3894b40ee None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:36.574571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eea164-1eac-4f4b-9be2-fac3894b40ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:36.599194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c4eea164-1eac-4f4b-9be2-fac3894b40ee None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:36.600404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c4eea164-1eac-4f4b-9be2-fac3894b40ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:36.691824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 244/491] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:36.804720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609891-e088-4866-a555-501d99ca76da None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:36.934181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609891-e088-4866-a555-501d99ca76da None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.001072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc381a0-960e-40d2-a424-61bc39884263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.001741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc381a0-960e-40d2-a424-61bc39884263 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.002019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc381a0-960e-40d2-a424-61bc39884263 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc381a0-960e-40d2-a424-61bc39884263 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.015726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc381a0-960e-40d2-a424-61bc39884263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-1cc381a0-960e-40d2-a424-61bc39884263 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:37.021268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:37.022175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:37.023626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 248/492] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:37.028067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eea164-1eac-4f4b-9be2-fac3894b40ee None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.123000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc381a0-960e-40d2-a424-61bc39884263 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.133955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:37.177335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eea164-1eac-4f4b-9be2-fac3894b40ee None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.250775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:37.257035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc381a0-960e-40d2-a424-61bc39884263 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.274613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.275466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.275741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.276009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.276685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] RBAC: Adding query filter params (name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:37.276987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:37.278391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:37.294385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 245/493] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:37.299876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.315494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249630c-6f8e-4850-a149-55d02c99da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.316547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249630c-6f8e-4850-a149-55d02c99da82 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.317042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249630c-6f8e-4850-a149-55d02c99da82 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.318058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249630c-6f8e-4850-a149-55d02c99da82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.329949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249630c-6f8e-4850-a149-55d02c99da82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4249630c-6f8e-4850-a149-55d02c99da82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:37.335834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:37.337258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:37.338290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:37.340973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 249/494] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:37.348247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249630c-6f8e-4850-a149-55d02c99da82 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.479919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:37.492057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c6ea2-1a08-41d2-887f-c6ec4b2c915e None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.544958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.545614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.545891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.546158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.561607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249630c-6f8e-4850-a149-55d02c99da82 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.565315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:37.566799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:37.589027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:37.590076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:37.590985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:37.590985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:37.590985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:37.590985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 246/495] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:37.600279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.637510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.638128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.638399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.638661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.639324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:37.639620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:37.640978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:37.661591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 250/496] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:37.675035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.678166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:37.797061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec31974-83f9-4511-b9f7-5efcaac6cd6f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.840567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa442-661c-41f6-9f3b-8c3481d53e93 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.891794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.892799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.893359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.893821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:37.894077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.894925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:37.896391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:37.898319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:37.904596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.906223 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.910437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.910964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.927575 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 247/497] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:37.929705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:37.931036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.933444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:37.963956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:37.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:37.966424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:37.966424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:37.966424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:37.969310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 251/498] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:37.970438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.060527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e393573-59e5-4dbe-a971-f9293f6cce15 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.062019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.096716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.097770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.098308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.099305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.107310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.109321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:38.123720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:38.124713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:47:38.125683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:38.129046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 248/499] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:38.134333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.203653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44e1ae-d36d-4c20-af41-72064d1f3cf9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.244035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ee059-ff30-4cae-bccd-c8b70780167f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.268495 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265f1c2-1ac2-4b3b-8734-b293b4491458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.269257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265f1c2-1ac2-4b3b-8734-b293b4491458 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.269466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265f1c2-1ac2-4b3b-8734-b293b4491458 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.269784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265f1c2-1ac2-4b3b-8734-b293b4491458 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.270428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265f1c2-1ac2-4b3b-8734-b293b4491458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:38.270753 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265f1c2-1ac2-4b3b-8734-b293b4491458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.272122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265f1c2-1ac2-4b3b-8734-b293b4491458 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.281955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a2cff-b352-432f-89e7-89c38c79d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.282934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a2cff-b352-432f-89e7-89c38c79d66b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.283414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a2cff-b352-432f-89e7-89c38c79d66b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.283886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a2cff-b352-432f-89e7-89c38c79d66b None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.284818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a2cff-b352-432f-89e7-89c38c79d66b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:38.285350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a2cff-b352-432f-89e7-89c38c79d66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.287544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a2cff-b352-432f-89e7-89c38c79d66b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.291051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 252/500] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:38.292242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb7ab-bed0-4e70-8267-c862a7c9c005 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.292527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb7ab-bed0-4e70-8267-c862a7c9c005 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.292792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bb7ab-bed0-4e70-8267-c862a7c9c005 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.294305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 253/501] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:38.295008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bb7ab-bed0-4e70-8267-c862a7c9c005 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.308746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 249/502] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:38.310375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42596455-79e5-4a5a-ab67-1ca0f764e476 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.310963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42596455-79e5-4a5a-ab67-1ca0f764e476 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.311456 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42596455-79e5-4a5a-ab67-1ca0f764e476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.332469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-42596455-79e5-4a5a-ab67-1ca0f764e476 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:38.334054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-42596455-79e5-4a5a-ab67-1ca0f764e476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:38.349120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.350431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.405968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 250/503] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:38.407154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42596455-79e5-4a5a-ab67-1ca0f764e476 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.440297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bb7ab-bed0-4e70-8267-c862a7c9c005 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.503652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.504419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.504701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.505029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.511649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42596455-79e5-4a5a-ab67-1ca0f764e476 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.522772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.524529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:38.550833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:38.551871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:47:38.552818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:38.555046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 254/504] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:38.560453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.582719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e705edb-097f-4200-bb9c-14b92c01652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.584174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e705edb-097f-4200-bb9c-14b92c01652d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.584678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e705edb-097f-4200-bb9c-14b92c01652d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.585147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e705edb-097f-4200-bb9c-14b92c01652d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.618688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.662036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e705edb-097f-4200-bb9c-14b92c01652d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.663837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e705edb-097f-4200-bb9c-14b92c01652d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.770415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 251/505] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:38.775740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e705edb-097f-4200-bb9c-14b92c01652d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.784016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.788943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585fc43-b259-43c7-b293-6bd9d451ee80 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.825930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.826539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.826920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.827121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.827793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:38.828172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.829630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.831692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.847388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 255/506] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:38.848076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.888966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e705edb-097f-4200-bb9c-14b92c01652d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.923621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1b5e0-11e2-4d22-a321-43cbd6face3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.924350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b5e0-11e2-4d22-a321-43cbd6face3e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.924709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b5e0-11e2-4d22-a321-43cbd6face3e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.924981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b5e0-11e2-4d22-a321-43cbd6face3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.938084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1b5e0-11e2-4d22-a321-43cbd6face3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.939686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1b5e0-11e2-4d22-a321-43cbd6face3e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-49c1b5e0-11e2-4d22-a321-43cbd6face3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:38.954397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:38.955341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:38.956259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:38.956259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:38.956259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:38.956430 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9ca92-71d0-45bb-ba3c-da8829fcbc94 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.959966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 252/507] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:38.961120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d41f-b47a-40b9-820a-296495e79967 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.961397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d41f-b47a-40b9-820a-296495e79967 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.961687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d41f-b47a-40b9-820a-296495e79967 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 253/508] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:38.965514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416d41f-b47a-40b9-820a-296495e79967 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.004338 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.005139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.005351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.005661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] PATH_INFO: `/v3/services/network` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.006265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.008331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:39.023595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:39.024684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:39.026012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 256/509] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:39.026826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.053555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.085995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416d41f-b47a-40b9-820a-296495e79967 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.088600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.126154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5f4c5-cfea-402d-913c-e148314e1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.126711 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5f4c5-cfea-402d-913c-e148314e1094 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.127146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5f4c5-cfea-402d-913c-e148314e1094 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.127424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5f4c5-cfea-402d-913c-e148314e1094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.135877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9951cd4-3865-4b0b-8dfd-237cd89fc31e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.137638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5f4c5-cfea-402d-913c-e148314e1094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.139065 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5f4c5-cfea-402d-913c-e148314e1094 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-15e5f4c5-cfea-402d-913c-e148314e1094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:39.153302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:39.154451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:39.155413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:39.155413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:39.155413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:39.155413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 254/510] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:39.155826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d930-9244-437f-ab79-4df4a9c4dc36 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.156105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d930-9244-437f-ab79-4df4a9c4dc36 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.156373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d930-9244-437f-ab79-4df4a9c4dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.172570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.173174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.173454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.173657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-aea7d930-9244-437f-ab79-4df4a9c4dc36 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:39.173751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.174390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:39.174693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.174843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-aea7d930-9244-437f-ab79-4df4a9c4dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:39.176063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.188822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 257/511] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:39.189630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.240411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 255/512] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:39.241935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a2cf-b2a1-4522-bf09-78bc29d71a8c None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.242215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a2cf-b2a1-4522-bf09-78bc29d71a8c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.242565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a2cf-b2a1-4522-bf09-78bc29d71a8c None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.243833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 256/513] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:39.244366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a2cf-b2a1-4522-bf09-78bc29d71a8c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.277660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.298114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c9d92-a860-4a7e-8c85-dd791eb53ee0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.332163 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.332758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.333606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.333876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.334496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] RBAC: Adding query filter params (name=network) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:39.334696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.334799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.336183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.340952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 258/514] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:39.341777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.358426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a2cf-b2a1-4522-bf09-78bc29d71a8c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.396637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa66047-6ed1-46a6-a744-3889bf018c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.397320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66047-6ed1-46a6-a744-3889bf018c92 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.397628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66047-6ed1-46a6-a744-3889bf018c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.398187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66047-6ed1-46a6-a744-3889bf018c92 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.398843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa66047-6ed1-46a6-a744-3889bf018c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:39.399143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa66047-6ed1-46a6-a744-3889bf018c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.400489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa66047-6ed1-46a6-a744-3889bf018c92 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.412414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 257/515] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:39.412414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662072e-8bb4-408c-9bdb-08d9a61a42ae None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.412414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662072e-8bb4-408c-9bdb-08d9a61a42ae None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.412414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662072e-8bb4-408c-9bdb-08d9a61a42ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.433002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9662072e-8bb4-408c-9bdb-08d9a61a42ae None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:39.434198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9662072e-8bb4-408c-9bdb-08d9a61a42ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:39.445758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c625f-5965-4dec-bb04-46c39fa4922d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.481237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.481898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.482172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.482438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.489439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.490898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:39.501978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:39.502888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 259/516] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:39.503814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.508440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.521531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 258/517] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:39.521531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662072e-8bb4-408c-9bdb-08d9a61a42ae None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.591543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.617602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e2b0-791f-4dda-b5e9-9f0d30cae4cb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.620781 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662072e-8bb4-408c-9bdb-08d9a61a42ae None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.651480 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.652024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.652302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.652568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.653190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] RBAC: Adding query filter params (type=network) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:39.653538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.654902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.657605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.658233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.658510 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.658781 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.669526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 260/518] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:39.669526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.677731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.679529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:39.692736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:39.693786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:39.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:39.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:39.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:39.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:39.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:39.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:39.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:39.694740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:39.695511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 259/519] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:39.696362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.742334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.780651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5169dd-1506-4133-8691-ab15098ed98e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.818793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.819429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.819704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.819973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.820175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26cb1e-ea88-4d4d-a3cd-604c1fd51958 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.820681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:39.821013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.822525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.836363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 261/520] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:39.837047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.860144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.860773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.861045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.861720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.861917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.863422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.866102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:39.878631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:39.879677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:39.880536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 260/521] 10.222.0.47 () {56 vars in 1129 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:39.882825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.946610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b8b2-cd06-4a27-bb21-b5bb1558e469 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.978306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.991308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.991912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.992191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.992456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.993136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:39.993438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.994880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.998502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59893d3f-1b6b-4cf7-aaac-7d656761e0fb None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:40.006463 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 262/522] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:40.007284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:40.040656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:40.041395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.041699 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.041968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.053746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:40.055200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:40.071042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:40.072018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:40.072917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:40.072917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:40.072917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:40.073088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 261/523] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:40.073996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:40.122186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a177a-a27e-4e2c-82de-32df82d63756 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:40.131968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:40.155879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:40.156486 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.156765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.157036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.157831 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] RBAC: Adding query filter params (role.id=df5e47546621472692145fb33dc3d1a2, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=6d66e92ebdd94630b887b31470be78ab) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:40.158143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:40.159578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:40.165402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 263/524] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:40 2022] GET /identity/v3/role_assignments?user.id=6d66e92ebdd94630b887b31470be78ab&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=df5e47546621472692145fb33dc3d1a2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:40.166186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:40.200819 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f9240-2d76-4bf7-9baf-4874b63fdd41 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:40.231465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:40.240202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:40.240895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.241175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.241442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.242166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:40.242469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:40.243976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:40.254095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 262/525] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Oct 14 12:47:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:40.256661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:40.294321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30de6fb-0999-471a-b8ab-73b7d17dac87 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:40.341197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0e451-d837-4f50-aa8c-ad4159d74645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:40.342077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0e451-d837-4f50-aa8c-ad4159d74645 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.342355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0e451-d837-4f50-aa8c-ad4159d74645 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.342626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0e451-d837-4f50-aa8c-ad4159d74645 None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/d360b800645041cf8caa43dcc0116761/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.345563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0e451-d837-4f50-aa8c-ad4159d74645 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=d360b800645041cf8caa43dcc0116761, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:40.347202 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0e451-d837-4f50-aa8c-ad4159d74645 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:40.369574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 264/526] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:40 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/d360b800645041cf8caa43dcc0116761/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:40.369574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0e451-d837-4f50-aa8c-ad4159d74645 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:40.397474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660f940-1f75-4319-ba63-7645e25448e7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:40.419721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:40.450662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:40.451758 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.452273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.452943 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.454412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:40.455268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:40.457008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:40.473294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 263/527] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:40.479973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:40.504978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0e451-d837-4f50-aa8c-ad4159d74645 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:40.525796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:40.556393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d20d16-efc2-4b05-9216-0b3bebb17e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:40.557008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20d16-efc2-4b05-9216-0b3bebb17e16 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.557284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20d16-efc2-4b05-9216-0b3bebb17e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.557583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d20d16-efc2-4b05-9216-0b3bebb17e16 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.558438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d20d16-efc2-4b05-9216-0b3bebb17e16 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:40.558747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d20d16-efc2-4b05-9216-0b3bebb17e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:40.560117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d20d16-efc2-4b05-9216-0b3bebb17e16 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:40.568064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 265/528] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Oct 14 12:47:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:40.619149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72434e-af72-4ce6-9de0-7c2f052ce540 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:40.663244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877f7da-8172-47f3-ac71-6625997b6aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:40.663864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877f7da-8172-47f3-ac71-6625997b6aa4 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.664142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877f7da-8172-47f3-ac71-6625997b6aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.664413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877f7da-8172-47f3-ac71-6625997b6aa4 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.665146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877f7da-8172-47f3-ac71-6625997b6aa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:40.666663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877f7da-8172-47f3-ac71-6625997b6aa4 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:40.690498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 264/529] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:40 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:42.050250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e397ac-b3c6-43b8-abb0-68098ea82a94 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.050778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e397ac-b3c6-43b8-abb0-68098ea82a94 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.050778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e397ac-b3c6-43b8-abb0-68098ea82a94 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.052435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 266/530] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:42.057283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d40209-aec6-481f-b8da-cccc8d4db4ed None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.057695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d40209-aec6-481f-b8da-cccc8d4db4ed None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.057860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d40209-aec6-481f-b8da-cccc8d4db4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.082579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a1d40209-aec6-481f-b8da-cccc8d4db4ed None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:42.083847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a1d40209-aec6-481f-b8da-cccc8d4db4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:42.107892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:42.172056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 265/531] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:42.472200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e397ac-b3c6-43b8-abb0-68098ea82a94 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:42.603818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e397ac-b3c6-43b8-abb0-68098ea82a94 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:42.649211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c757d-447b-40d2-aff1-d2e502170828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:42.650199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c757d-447b-40d2-aff1-d2e502170828 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.650674 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c757d-447b-40d2-aff1-d2e502170828 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.651158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c757d-447b-40d2-aff1-d2e502170828 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.652029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c757d-447b-40d2-aff1-d2e502170828 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:42.653857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c757d-447b-40d2-aff1-d2e502170828 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:42.679544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 267/532] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:47:42 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:42.987621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad404-1280-4f41-9d35-83319a490dd9 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.987953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad404-1280-4f41-9d35-83319a490dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.988239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad404-1280-4f41-9d35-83319a490dd9 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.990425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 266/533] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:42.995490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04177892-d13b-425b-805a-df661a044e72 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.996028 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04177892-d13b-425b-805a-df661a044e72 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.996528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04177892-d13b-425b-805a-df661a044e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.018800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-04177892-d13b-425b-805a-df661a044e72 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:43.020001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-04177892-d13b-425b-805a-df661a044e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:43.056561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:43.105245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 268/534] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:42 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:43.107563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09274e-e2a8-4f8e-b6e3-e60c2d62d613 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.108019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09274e-e2a8-4f8e-b6e3-e60c2d62d613 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.108099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09274e-e2a8-4f8e-b6e3-e60c2d62d613 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.109931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 267/535] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:43.115652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728acc8-9edf-4bc3-9633-416026df13fc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.115935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728acc8-9edf-4bc3-9633-416026df13fc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.116204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728acc8-9edf-4bc3-9633-416026df13fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.134603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f728acc8-9edf-4bc3-9633-416026df13fc None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:43.135776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f728acc8-9edf-4bc3-9633-416026df13fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:43.214299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 269/536] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:43 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:43.323414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875c17f-072c-4170-98df-fd9b7fe40b39 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.323606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875c17f-072c-4170-98df-fd9b7fe40b39 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.323919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875c17f-072c-4170-98df-fd9b7fe40b39 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.325581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 268/537] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:43.330865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10fbb-1b0a-4bbf-802a-824fa7ced128 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.331146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10fbb-1b0a-4bbf-802a-824fa7ced128 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.331418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d10fbb-1b0a-4bbf-802a-824fa7ced128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.357511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-32d10fbb-1b0a-4bbf-802a-824fa7ced128 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:43.359117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-32d10fbb-1b0a-4bbf-802a-824fa7ced128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:43.429104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875c17f-072c-4170-98df-fd9b7fe40b39 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:43.447118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 270/538] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:43 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:43.607390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875c17f-072c-4170-98df-fd9b7fe40b39 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:43.660279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c440dc-0f81-488d-88d0-44aef4a23fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:43.660606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4403-0bfe-48be-b9fc-cc962de0a348 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.660854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4403-0bfe-48be-b9fc-cc962de0a348 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.660957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c440dc-0f81-488d-88d0-44aef4a23fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.661130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c4403-0bfe-48be-b9fc-cc962de0a348 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.661223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c440dc-0f81-488d-88d0-44aef4a23fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.661463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c440dc-0f81-488d-88d0-44aef4a23fa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.662885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 271/539] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:43.663426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c4403-0bfe-48be-b9fc-cc962de0a348 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:43.674073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c440dc-0f81-488d-88d0-44aef4a23fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-39c440dc-0f81-488d-88d0-44aef4a23fa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:43.680515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:43.681420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:43.682702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 269/540] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:43.683389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4cec3-1201-41de-ba61-3e9c88f75b6b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.683695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4cec3-1201-41de-ba61-3e9c88f75b6b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.683797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4cec3-1201-41de-ba61-3e9c88f75b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.693365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:43.709860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-7ee4cec3-1201-41de-ba61-3e9c88f75b6b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:43.711070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7ee4cec3-1201-41de-ba61-3e9c88f75b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:43.726772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:43.780173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c4403-0bfe-48be-b9fc-cc962de0a348 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:43.789336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 270/541] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:43 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:43.790073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4cec3-1201-41de-ba61-3e9c88f75b6b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:43.821851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1cf3-325e-4cba-8d5f-f5cf72898e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:43.822533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1cf3-325e-4cba-8d5f-f5cf72898e9c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.822808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1cf3-325e-4cba-8d5f-f5cf72898e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.823066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe1cf3-325e-4cba-8d5f-f5cf72898e9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.834442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe1cf3-325e-4cba-8d5f-f5cf72898e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-2abe1cf3-325e-4cba-8d5f-f5cf72898e9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:43.839194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:43.840153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:43.840995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 272/542] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:43.841758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1cf3-325e-4cba-8d5f-f5cf72898e9c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:43.927267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:43.932502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4cec3-1201-41de-ba61-3e9c88f75b6b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:43.946974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe1cf3-325e-4cba-8d5f-f5cf72898e9c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:43.988752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:43.989386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.989686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.989948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.990611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:43.990912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:43.992257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:43.996302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f2aca-8bd8-4326-80aa-51e9d5ac3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:43.996904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f2aca-8bd8-4326-80aa-51e9d5ac3845 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.997175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f2aca-8bd8-4326-80aa-51e9d5ac3845 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.997436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f2aca-8bd8-4326-80aa-51e9d5ac3845 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.998097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f2aca-8bd8-4326-80aa-51e9d5ac3845 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:43.999432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f2aca-8bd8-4326-80aa-51e9d5ac3845 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.010930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 271/543] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:44.012403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.015410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 273/544] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:47:43 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:44.021779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f2aca-8bd8-4326-80aa-51e9d5ac3845 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.046301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.181740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3823291-2458-4e2d-857e-61706404d2de None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.212157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f2aca-8bd8-4326-80aa-51e9d5ac3845 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.230358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.231593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.231911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.232188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.233001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:44.233312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.235090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.244805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 272/545] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:44.245444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.262932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.263560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.263827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.264095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.273543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.276719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.278353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:44.294273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:44.295482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:44.296620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:44.296620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:44.296620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:44.298535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 274/546] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:44.299366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.343396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.378929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841251-7f9c-46bd-9073-dc608b9affc4 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.419410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bd77a-73bd-4c18-8962-53a75581bf12 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.422051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc5aa3-b385-4c5f-8703-a3592ae235f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.423653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc5aa3-b385-4c5f-8703-a3592ae235f2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.423999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc5aa3-b385-4c5f-8703-a3592ae235f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.424334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc5aa3-b385-4c5f-8703-a3592ae235f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.440685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc5aa3-b385-4c5f-8703-a3592ae235f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-a3cc5aa3-b385-4c5f-8703-a3592ae235f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:44.447594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:44.448776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:44.449901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:44.451042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 273/547] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:44.456097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc5aa3-b385-4c5f-8703-a3592ae235f2 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.467646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.468274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.468548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.468821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.481900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.483776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:44.500066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:44.501082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:44.502046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:44.502046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:44.502046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:44.504230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 275/548] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:44.505358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.553570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.571777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc5aa3-b385-4c5f-8703-a3592ae235f2 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.609587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.610597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.611079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.611550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.612402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:44.612904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.614684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.616420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.618795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec7195-88de-486f-85d1-af8fbc7f1561 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.634165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 274/549] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:44.636450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.659492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.660097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.660369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.660638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.661866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:44.662165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.663640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.676508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 276/550] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:44.676508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.753303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101e360-7377-40a0-a446-a1037f2c9e82 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.778378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641f1e-a6f9-4e0b-81ad-e1b46e44d7a0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.780926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.794485 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.795534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.796033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.796508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.797370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:44.798083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.799805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.812907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 275/551] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:44.814258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.817762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.818488 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.818764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.819032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.827406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.828954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:44.842193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:44.843197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:47:44.844145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:44.848277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 277/552] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:44.849620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.882616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.931530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6d68a-0b15-4f72-8fca-977d3977c0a4 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.958620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b873efa-c36a-42a7-a8a7-5bebe147bde9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.969933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.970913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.971419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.971910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.985154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.987105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.996573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.996825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.997037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.997279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.006569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:45.007791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:45.008714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:45.009649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:45.009649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:45.009649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:45.009834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.015572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 276/553] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:45.015572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:45.028406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:45.029450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:45.030469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 278/554] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:45.031085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.058143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.133332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957a7e-5d8f-4e6b-bdc3-a100640a9778 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.139645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bb39b-4514-4fac-b9fb-b278b37863eb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.141392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.171700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.172539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.172975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.173646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.174388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:45.174772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.176477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.178987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.179821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.180278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.180735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.181715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:45.182209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.183720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.195853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 277/555] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:45.196786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.198243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 279/556] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:45.203614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.299669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.314675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca91dd-6b5c-4c05-8ade-4588cbc2978c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.318365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58dff9-d228-4d5b-8d3c-5a8675c3ff13 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.352041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.352623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.352898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.353166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.354111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:45.354477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.356027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.357073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.358093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.358663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.359421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.368157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.369893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.376314 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 278/557] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:45.377131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:45.384385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:45.385387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:47:45.386456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:45.389144 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 280/558] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:45.390314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.401946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.475772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9eae6-1d0b-4a5b-a051-92f051407c12 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.498663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327973c-d078-419c-bbd0-63993c5229c4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.510093 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83d78-4746-4a42-bde9-75d358aa4420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.510710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83d78-4746-4a42-bde9-75d358aa4420 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.510988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83d78-4746-4a42-bde9-75d358aa4420 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.511257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83d78-4746-4a42-bde9-75d358aa4420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.521049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83d78-4746-4a42-bde9-75d358aa4420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.522565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83d78-4746-4a42-bde9-75d358aa4420 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.534772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7f5a3-aab4-4f43-bc39-560fc22b69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.535528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7f5a3-aab4-4f43-bc39-560fc22b69db None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.535980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7f5a3-aab4-4f43-bc39-560fc22b69db None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.536410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7f5a3-aab4-4f43-bc39-560fc22b69db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2df83d78-4746-4a42-bde9-75d358aa4420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:45.536825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:45.537926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:45.538832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:45.538832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:45.538832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:45.538832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 279/559] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:45.539373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfc2b7-89c0-4293-8002-d7a49ec596c8 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.539653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfc2b7-89c0-4293-8002-d7a49ec596c8 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.539925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfc2b7-89c0-4293-8002-d7a49ec596c8 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.541263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 280/560] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:45.545730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfc2b7-89c0-4293-8002-d7a49ec596c8 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.561159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.617998 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7f5a3-aab4-4f43-bc39-560fc22b69db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.619445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7f5a3-aab4-4f43-bc39-560fc22b69db None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.624154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.652176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfc2b7-89c0-4293-8002-d7a49ec596c8 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.690600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.691204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.691481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.691749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.692573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:45.692867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.694925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.717008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 281/561] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:45.717008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.741018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 281/562] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:47:45.741018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f43f3-344b-4e80-acc7-4e385ea2d180 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.741018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f43f3-344b-4e80-acc7-4e385ea2d180 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.741018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f43f3-344b-4e80-acc7-4e385ea2d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.758526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c22f43f3-344b-4e80-acc7-4e385ea2d180 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:45.759698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c22f43f3-344b-4e80-acc7-4e385ea2d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:45.802199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.827828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3968a2-bdbc-46a0-89bb-0ae431f7f798 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.837698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 282/563] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:45.837698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f43f3-344b-4e80-acc7-4e385ea2d180 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.869836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.875716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.876644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.877301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.877618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.878273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:45.878578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.880576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.897845 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 282/564] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:45.897845 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.951477 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f43f3-344b-4e80-acc7-4e385ea2d180 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.993900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.994874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.995349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.995816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.006392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acc9f6-9db0-4328-a1a2-cb35b261782f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.007413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.009280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:46.026044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:46.027026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:46.027962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:46.027962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:46.027962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:46.033737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 283/565] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:46.033737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.050149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.052107 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.052633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.053050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.063985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:46.067110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.069038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:46.088326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:46.089332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:46.090787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:46.090787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:46.090787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:46.092338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 283/566] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:46.092338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.142160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:46.152548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bc2d0-b18e-47e6-b2c1-566267980266 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.191045 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.191702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.192059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.192840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.200577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.202106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.208771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206dd1a-7192-46a0-853a-fcd75e620a8c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:46.214407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:46.215283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:46.216308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 284/567] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:46.216798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.251184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.251613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.251894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.252236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.252817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:46.253116 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.254577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.267013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 284/568] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:46.267654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.310556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:46.325547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feac18-7d93-4631-a66c-fee14c314fe4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.358722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.359509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.359784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.360052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.360686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:46.360993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.362412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.368885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda8793-a02e-493b-9453-93e3ee24fe92 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.371152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:46.374575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 285/569] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:46.375371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.402655 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.403274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.403549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.403818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] PATH_INFO: `/v3/services/network` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.404395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.405767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:46.414827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:46.417728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:46.418818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 285/570] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/services/network => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:46.419807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.475194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22262c1-1d71-4be3-983f-47d387a6c973 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.507902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd9a22-d6c2-4099-8656-fd5a538f9c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.508497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd9a22-d6c2-4099-8656-fd5a538f9c33 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.508768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd9a22-d6c2-4099-8656-fd5a538f9c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.509037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd9a22-d6c2-4099-8656-fd5a538f9c33 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.509741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd9a22-d6c2-4099-8656-fd5a538f9c33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:46.510042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd9a22-d6c2-4099-8656-fd5a538f9c33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.511459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd9a22-d6c2-4099-8656-fd5a538f9c33 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.522314 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c0848-ce92-4330-9dcf-8c4d96417523 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.522750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 286/571] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:46.523927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9a262-285d-453d-b7e3-3165633ba760 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.524205 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9a262-285d-453d-b7e3-3165633ba760 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.524471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9a262-285d-453d-b7e3-3165633ba760 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.525665 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 287/572] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:46.528718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9a262-285d-453d-b7e3-3165633ba760 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.538213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:46.562999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.563620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.563892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.564153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.573946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.575392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:46.586731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:46.587792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 286/573] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:46.588773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.620639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:46.634994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9a262-285d-453d-b7e3-3165633ba760 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.675921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.676576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.676851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.677121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.683709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.685145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.696618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eab814-5f9f-43b5-a859-8f230d57d0a3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:46.696829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:46.697877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 288/574] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:46.698985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.730195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1622f3-d8ab-4ed1-bf48-b5ececee7eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.730942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1622f3-d8ab-4ed1-bf48-b5ececee7eba None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.731336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1622f3-d8ab-4ed1-bf48-b5ececee7eba None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.731697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1622f3-d8ab-4ed1-bf48-b5ececee7eba None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.732413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1622f3-d8ab-4ed1-bf48-b5ececee7eba None admin] RBAC: Adding query filter params (name=network) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:46.732820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1622f3-d8ab-4ed1-bf48-b5ececee7eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.734618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1622f3-d8ab-4ed1-bf48-b5ececee7eba None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.739494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 287/575] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:46.740709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ec3c-5278-469f-b462-403b45c0d389 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.741001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ec3c-5278-469f-b462-403b45c0d389 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.741260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56ec3c-5278-469f-b462-403b45c0d389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.759235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-fa56ec3c-5278-469f-b462-403b45c0d389 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:46.760434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-fa56ec3c-5278-469f-b462-403b45c0d389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:46.765962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:46.799942 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a35df-fa5b-41b4-8a16-e438a57ec2a8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.827104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 288/576] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:46.827935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56ec3c-5278-469f-b462-403b45c0d389 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.834349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046b2bd-8de0-4711-b7cd-956f9516406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:46.835126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b2bd-8de0-4711-b7cd-956f9516406d None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:46.835487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b2bd-8de0-4711-b7cd-956f9516406d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:46.835851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b2bd-8de0-4711-b7cd-956f9516406d None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/6d66e92ebdd94630b887b31470be78ab/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:46.837887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046b2bd-8de0-4711-b7cd-956f9516406d None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=6d66e92ebdd94630b887b31470be78ab, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:46.839407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046b2bd-8de0-4711-b7cd-956f9516406d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:46.852327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:46.860357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 289/577] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:46 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/6d66e92ebdd94630b887b31470be78ab/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:46.861049 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046b2bd-8de0-4711-b7cd-956f9516406d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:46.948834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56ec3c-5278-469f-b462-403b45c0d389 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:46.999709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046b2bd-8de0-4711-b7cd-956f9516406d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.001765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.002460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.002738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.003007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.004138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:47.004138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.006335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.024280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 289/578] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:47.024280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:47.036764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:47.048849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.049781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.050236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.050658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.052186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:47.052684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.054351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.069067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 290/579] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:47.070513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:47.122158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:47.145908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b5c56-74e2-48bc-8dd6-16a42f975ad3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.184153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.184749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.185018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.185281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.185945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:47.186245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.187249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8065a9-2406-4c07-a0fd-c03729237353 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.187594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.198095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 290/580] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:47.198095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:47.227416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a781cb-def1-49b8-b1de-c41835481659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.228096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a781cb-def1-49b8-b1de-c41835481659 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.228442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a781cb-def1-49b8-b1de-c41835481659 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.228778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a781cb-def1-49b8-b1de-c41835481659 None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/b9daad0debe14575922551c03889ac02/roles/df5e47546621472692145fb33dc3d1a2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.244608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a781cb-def1-49b8-b1de-c41835481659 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=b9daad0debe14575922551c03889ac02, role_id=df5e47546621472692145fb33dc3d1a2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.246109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a781cb-def1-49b8-b1de-c41835481659 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.269521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 291/581] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:47 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/b9daad0debe14575922551c03889ac02/roles/df5e47546621472692145fb33dc3d1a2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:47.269521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a781cb-def1-49b8-b1de-c41835481659 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:47.313394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:47.330303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79500b7e-a690-4652-bc36-5b0807d8f9b3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.379840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.380553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.381423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.381797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.382935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=d360b800645041cf8caa43dcc0116761) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:47.383317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.385428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.394837 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a781cb-def1-49b8-b1de-c41835481659 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.395330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 291/582] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/role_assignments?user.id=d360b800645041cf8caa43dcc0116761&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:47.396235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:47.414961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:47.443486 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.444534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.444976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.445342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.447079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.450362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:47.462220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:47.463517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:47.464666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:47.466724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 292/583] 10.222.0.47 () {56 vars in 1129 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:47.472519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:47.540457 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c78384-6e98-4407-8961-6323c9b2e995 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.578959 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.579678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.580024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.580401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.581351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] RBAC: Adding query filter params (interface=public, service_id=cd68469275a8469c86d3a399051f21ee, region_id=RegionOne) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:47.581731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.583706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.594496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 292/584] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/endpoints?service_id=cd68469275a8469c86d3a399051f21ee&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:47.600550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:47.614305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:47.618219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe851-7059-4423-afa2-bc40ecc9b456 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.686509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.687319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.687740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.688012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.689167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:47.689513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.691192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.698464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 293/585] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:47.700910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:47.705192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:47.734827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e2b66-ea6f-480e-baa0-fb1b2dc5e034 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.778587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f17e-0b74-4a4f-97cd-45552128403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.779294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f17e-0b74-4a4f-97cd-45552128403f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.780208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f17e-0b74-4a4f-97cd-45552128403f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.780208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175f17e-0b74-4a4f-97cd-45552128403f None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.780880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175f17e-0b74-4a4f-97cd-45552128403f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.782560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175f17e-0b74-4a4f-97cd-45552128403f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.791032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 293/586] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:47.836330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82d6c0-87a7-40b3-b0c4-a58f93590fda None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:47.875012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:47.875626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.875904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.876175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.876814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:47.877115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:47.878528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:47.884391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 294/587] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:47.889835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f17e-0b74-4a4f-97cd-45552128403f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.049402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175f17e-0b74-4a4f-97cd-45552128403f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.091149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e433cba-6eae-46a1-a781-6b55b0b1e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.091759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433cba-6eae-46a1-a781-6b55b0b1e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.092034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433cba-6eae-46a1-a781-6b55b0b1e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.092303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433cba-6eae-46a1-a781-6b55b0b1e3c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.093009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e433cba-6eae-46a1-a781-6b55b0b1e3c3 None admin] RBAC: Adding query filter params (interface=public, service_id=19c78cbbf45b4cccb0b04fce90dfff51, region_id=RegionOne) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:48.093314 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e433cba-6eae-46a1-a781-6b55b0b1e3c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:48.094770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e433cba-6eae-46a1-a781-6b55b0b1e3c3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:48.102572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 294/588] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/endpoints?service_id=19c78cbbf45b4cccb0b04fce90dfff51&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:48.107898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.146263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:48.249080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbadcb3-9275-4674-8ea0-942c8f960fae None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.295263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f9ee-0c36-4350-8b30-cb3c133ca3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.296351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f9ee-0c36-4350-8b30-cb3c133ca3ae None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.296892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f9ee-0c36-4350-8b30-cb3c133ca3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.297359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f9ee-0c36-4350-8b30-cb3c133ca3ae None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.298228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f9ee-0c36-4350-8b30-cb3c133ca3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:48.299853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f9ee-0c36-4350-8b30-cb3c133ca3ae None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:48.306069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 295/589] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:47:48 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:49.530785 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b13c5-a8ec-4bbf-a7eb-5eadb6134c8b None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:49.531328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b13c5-a8ec-4bbf-a7eb-5eadb6134c8b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:49.531328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b13c5-a8ec-4bbf-a7eb-5eadb6134c8b None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:49.532904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 295/590] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:49.538402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e5d6-6317-4cd3-bb29-6c828a6bfbc2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:49.539198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e5d6-6317-4cd3-bb29-6c828a6bfbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:49.539682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235e5d6-6317-4cd3-bb29-6c828a6bfbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:49.566439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b235e5d6-6317-4cd3-bb29-6c828a6bfbc2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:49.568013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b235e5d6-6317-4cd3-bb29-6c828a6bfbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:49.658066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 296/591] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:49.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce825-e971-4ac2-bcfe-51139ef6998c None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:49.835322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce825-e971-4ac2-bcfe-51139ef6998c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:49.835580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce825-e971-4ac2-bcfe-51139ef6998c None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:49.837086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 296/592] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:49.841990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834ed2-8c5d-464c-9d81-95c3f83ba2c3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:49.842522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834ed2-8c5d-464c-9d81-95c3f83ba2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:49.843007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834ed2-8c5d-464c-9d81-95c3f83ba2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:49.870757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-53834ed2-8c5d-464c-9d81-95c3f83ba2c3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:49.872237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-53834ed2-8c5d-464c-9d81-95c3f83ba2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:49.890035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:49.962678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 297/593] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:49.968852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ce825-e971-4ac2-bcfe-51139ef6998c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:49.986452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:50.127143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ce825-e971-4ac2-bcfe-51139ef6998c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:50.171285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286503d-b64d-4a22-b01d-1b375e5d8d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:50.171918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286503d-b64d-4a22-b01d-1b375e5d8d1a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.172190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286503d-b64d-4a22-b01d-1b375e5d8d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.172453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286503d-b64d-4a22-b01d-1b375e5d8d1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.187227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286503d-b64d-4a22-b01d-1b375e5d8d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-9286503d-b64d-4a22-b01d-1b375e5d8d1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:50.192565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:50.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:50.194535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 297/594] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:50.200132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834ed2-8c5d-464c-9d81-95c3f83ba2c3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:50.250307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d340-6367-4fcc-9be6-8852bea16b90 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.250648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d340-6367-4fcc-9be6-8852bea16b90 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.250847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d340-6367-4fcc-9be6-8852bea16b90 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.252437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 298/595] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:50.258114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257a881-c169-468d-9803-261b90a178b6 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.258396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257a881-c169-468d-9803-261b90a178b6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.258665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257a881-c169-468d-9803-261b90a178b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.278955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8257a881-c169-468d-9803-261b90a178b6 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:50.280166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8257a881-c169-468d-9803-261b90a178b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:50.342350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834ed2-8c5d-464c-9d81-95c3f83ba2c3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:50.360620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:50.365248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 299/596] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:47:50.366194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257a881-c169-468d-9803-261b90a178b6 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:50.383205 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:50.383749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.384026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.384348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.385024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:50.385328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:50.386817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:50.400370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 298/597] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:50.401620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:50.419084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:50.475736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257a881-c169-468d-9803-261b90a178b6 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:50.506424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f9a6d-9a24-41ad-9256-70ea4cc43e6d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:50.513465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4692c32-2342-4876-8237-02cce1e6dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:50.514470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4692c32-2342-4876-8237-02cce1e6dee3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.514922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4692c32-2342-4876-8237-02cce1e6dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.515391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4692c32-2342-4876-8237-02cce1e6dee3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.527850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4692c32-2342-4876-8237-02cce1e6dee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-f4692c32-2342-4876-8237-02cce1e6dee3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:50.533010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:50.534386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:47:50.535250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:50.538248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 300/598] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:47:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:50.546648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4692c32-2342-4876-8237-02cce1e6dee3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:50.549446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:50.550188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.550540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.550888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.562715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:50.564350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:50.579698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:50.580902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:50.582022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:50.582022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:50.582022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:50.588166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 299/599] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:50.589529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:50.666932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:50.705190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f975d8-da2c-41b5-9ad0-7034e21910f3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:50.709056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:50.754087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7b261-7686-40cc-a422-336f67369ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:50.754849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7b261-7686-40cc-a422-336f67369ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.755126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7b261-7686-40cc-a422-336f67369ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.755397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7b261-7686-40cc-a422-336f67369ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.756047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7b261-7686-40cc-a422-336f67369ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:50.756352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7b261-7686-40cc-a422-336f67369ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:50.757762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7b261-7686-40cc-a422-336f67369ba2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:50.775018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 300/600] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:50.775018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296a1a-7cee-4d75-ad6b-63336a06c986 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.775018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296a1a-7cee-4d75-ad6b-63336a06c986 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.775018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd296a1a-7cee-4d75-ad6b-63336a06c986 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.775018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 301/601] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:50.775018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd296a1a-7cee-4d75-ad6b-63336a06c986 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:50.786005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4692c32-2342-4876-8237-02cce1e6dee3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:50.824130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:50.824741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.825020 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.825302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.826002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:50.826403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:50.827675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:50.836030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 301/602] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:47:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:50.836648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:50.890638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd296a1a-7cee-4d75-ad6b-63336a06c986 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:50.917122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:50.926629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2b19-e058-43f0-93bc-afc53dcdea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:50.927321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2b19-e058-43f0-93bc-afc53dcdea22 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.927600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2b19-e058-43f0-93bc-afc53dcdea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.927858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2b19-e058-43f0-93bc-afc53dcdea22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.928423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2b19-e058-43f0-93bc-afc53dcdea22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:50.929835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2b19-e058-43f0-93bc-afc53dcdea22 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-ab8c2b19-e058-43f0-93bc-afc53dcdea22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:50.939149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:50.940147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:50.941085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 302/603] 10.222.0.47 () {56 vars in 1132 bytes} [Fri Oct 14 12:47:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:50.943112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a631a-2f71-449f-ad21-06e3ae1e0c3f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.943112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a631a-2f71-449f-ad21-06e3ae1e0c3f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.943112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a631a-2f71-449f-ad21-06e3ae1e0c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.949512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e60843-28ec-4a97-91e4-84b74e5d2f50 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:50.959850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fe5a631a-2f71-449f-ad21-06e3ae1e0c3f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:50.961010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fe5a631a-2f71-449f-ad21-06e3ae1e0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:50.964847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:50.991336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:50.991971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.992247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.992766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.000509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.001980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:51.013612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:51.014589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 302/604] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:51.015531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.053865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 303/605] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:51.054694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a631a-2f71-449f-ad21-06e3ae1e0c3f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.136549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ea46a-09d7-4834-a9dc-6f8da7bd6d95 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.172317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a631a-2f71-449f-ad21-06e3ae1e0c3f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.177070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.177994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.178468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.178941 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.190888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.192905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.200050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:51.207103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:51.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:51.209232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:51.209232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:51.209232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:51.209232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 303/606] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:51.209476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.218315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af13f1f-3be0-4dc0-8672-3003e2ee2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.219120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13f1f-3be0-4dc0-8672-3003e2ee2753 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.219556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13f1f-3be0-4dc0-8672-3003e2ee2753 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.219983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af13f1f-3be0-4dc0-8672-3003e2ee2753 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.220755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af13f1f-3be0-4dc0-8672-3003e2ee2753 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:51.221245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af13f1f-3be0-4dc0-8672-3003e2ee2753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.222698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af13f1f-3be0-4dc0-8672-3003e2ee2753 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.231485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 304/607] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.231485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b0c8-ef07-4a05-beb9-27535992265f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.231485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b0c8-ef07-4a05-beb9-27535992265f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.231485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b0c8-ef07-4a05-beb9-27535992265f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.231485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 305/608] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:51.231485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0b0c8-ef07-4a05-beb9-27535992265f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.249779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.325376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3760008-46f4-4132-ab8a-e3e07151f10e None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.336165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0b0c8-ef07-4a05-beb9-27535992265f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.360093 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.360690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.360966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.361237 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.361995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:51.362304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.363744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.369863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05951791-ed5e-4e38-841a-b2c7e33ee51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.370468 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951791-ed5e-4e38-841a-b2c7e33ee51a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.370741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951791-ed5e-4e38-841a-b2c7e33ee51a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.371009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05951791-ed5e-4e38-841a-b2c7e33ee51a None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.371643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951791-ed5e-4e38-841a-b2c7e33ee51a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:51.371944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951791-ed5e-4e38-841a-b2c7e33ee51a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.373289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05951791-ed5e-4e38-841a-b2c7e33ee51a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.380606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 304/609] 10.222.0.47 () {56 vars in 1135 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.381411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.388605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 306/610] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.390010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de29e4-b392-445f-a265-7e61d996ad41 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.390294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de29e4-b392-445f-a265-7e61d996ad41 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.390566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de29e4-b392-445f-a265-7e61d996ad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.408135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-99de29e4-b392-445f-a265-7e61d996ad41 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:51.409307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-99de29e4-b392-445f-a265-7e61d996ad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:51.448677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.463231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.474271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 307/611] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:51.475069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de29e4-b392-445f-a265-7e61d996ad41 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.479503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94fb3-6e50-429d-9d66-476c539a9934 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.514750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.515349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.515630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.516670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:51.516976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.518399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.533523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 305/612] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.533523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.601823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de29e4-b392-445f-a265-7e61d996ad41 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.641960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.642722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.643061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.643402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] PATH_INFO: `/v3/services/network` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.644126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.645802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:51.655573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:51.656645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:51.657880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 308/613] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:51.658702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.671724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d19d4-6b70-485e-850b-897cd953a23a None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.705797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.716414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f271d-930f-442b-9a21-d2596e136381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.717124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f271d-930f-442b-9a21-d2596e136381 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.717399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f271d-930f-442b-9a21-d2596e136381 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.717721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f271d-930f-442b-9a21-d2596e136381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.742503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.771982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2df85-62f7-42ec-be02-b9ea043f75ca None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.804829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f271d-930f-442b-9a21-d2596e136381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.806254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.806407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f271d-930f-442b-9a21-d2596e136381 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.806879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.807151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.807419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.814879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.816015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:51.828803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:51.829828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:47:51.830793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:51.831900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 309/614] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:51.832933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.912123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 306/615] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:47:51.913382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f271d-930f-442b-9a21-d2596e136381 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.938665 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.942960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30bb5-2fca-4ea7-a2c8-42c83c81937c None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.967674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.981960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.982822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.983238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.983676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.984559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] RBAC: Adding query filter params (name=network) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:51.984863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.986259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.991579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 310/616] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.992256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.033685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f271d-930f-442b-9a21-d2596e136381 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.069927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.070727 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.071006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.071277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.071861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.073219 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:52.082810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:52.083807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:52.084693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 307/617] 10.222.0.47 () {56 vars in 1129 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:52.085531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.116434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5881-00e2-4b75-ae20-52ac35106d9d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.155273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.155894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.156169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.156414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.157147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:52.157441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.158912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.176990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 311/618] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:52.177847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.194080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fd55-79df-44be-b0e3-1ce1fb57b64e None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.199947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:52.208263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:52.234037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.234697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.234900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.235126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.246256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.247686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:52.261904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:52.263097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:52.263997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:52.263997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:52.263997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:52.263997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 308/619] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:52.264230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.291841 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe451-2264-4b5e-ba88-77e236d0ead5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.326990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.327597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.327874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.328141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.328792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] RBAC: Adding query filter params (type=network) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:52.329094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.330500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.336392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 312/620] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:52.338310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.376261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737f46-dcf7-49da-bf5a-0dcc014dc71d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.413864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.414494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.414773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.415155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.415794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:52.416095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.417447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.426462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 309/621] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:52.426462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.433158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:52.453858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:52.454438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46b70d-692b-4eb2-b820-c7e4774b0c69 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.489560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec59fd1-c8b9-47b3-a3fc-0ea5027da295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.490101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec59fd1-c8b9-47b3-a3fc-0ea5027da295 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.490380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec59fd1-c8b9-47b3-a3fc-0ea5027da295 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.490712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec59fd1-c8b9-47b3-a3fc-0ea5027da295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.535205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b2b4-c5d1-40d5-bde7-b0fddc3df436 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.561030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec59fd1-c8b9-47b3-a3fc-0ea5027da295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.565048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec59fd1-c8b9-47b3-a3fc-0ea5027da295 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.572372 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.572970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.573245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.573536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.574187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:52.574484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.575834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.587989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 310/622] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:52.588742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.659064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:52.683617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:52.684514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 313/623] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:47:52.685816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec59fd1-c8b9-47b3-a3fc-0ea5027da295 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.694496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b629a0c-adc8-4d18-b84b-d4115cef3bcc None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.729647 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ffebd-45f8-48fa-b514-e4cc395f491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.730292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ffebd-45f8-48fa-b514-e4cc395f491e None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.730567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ffebd-45f8-48fa-b514-e4cc395f491e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.730826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ffebd-45f8-48fa-b514-e4cc395f491e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.731487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ffebd-45f8-48fa-b514-e4cc395f491e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.733433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ffebd-45f8-48fa-b514-e4cc395f491e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.761555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 311/624] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:47:52 2022] POST /identity/v3/endpoints => generated 337 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:52.761555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ffebd-45f8-48fa-b514-e4cc395f491e None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.811396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec59fd1-c8b9-47b3-a3fc-0ea5027da295 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.862932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.864178 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.864458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.864724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.865410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:52.865703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.867276 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.873874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 314/625] 10.222.0.47 () {56 vars in 1124 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:52.874930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.878246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ffebd-45f8-48fa-b514-e4cc395f491e None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.917518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.918552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.919089 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.919571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.927945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.928690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:52.930132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:52.942792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:52.943765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:52.944670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:52.944670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:52.944670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:52.944670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:52.944670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:52.944670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:52.944670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:52.944670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:52.947003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 312/626] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:52.948192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.953802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:53.005760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc51b-771c-436e-828a-7d0b1097adec None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.058726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.059293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.059572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.059843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.073669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:53.075124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:53.075646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ed2e-ce99-4f20-a5cf-4ceeeb3d6be5 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:53.091299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:53.092487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:53.093394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:53.093394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:53.093394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:53.093394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 315/627] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:53.093900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:53.118175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561d50b-a9ad-4c7d-bfb7-c2113d434fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.118779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561d50b-a9ad-4c7d-bfb7-c2113d434fca None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.119051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561d50b-a9ad-4c7d-bfb7-c2113d434fca None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.119378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561d50b-a9ad-4c7d-bfb7-c2113d434fca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.120040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561d50b-a9ad-4c7d-bfb7-c2113d434fca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:53.121384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561d50b-a9ad-4c7d-bfb7-c2113d434fca None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:53.145915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 313/628] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:47:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:53.147287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561d50b-a9ad-4c7d-bfb7-c2113d434fca None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:53.205431 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:53.213939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6583cd-fba7-470c-a8a5-b22cc2445a39 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.241864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:53.263760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.264864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.265350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.265850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.266823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:53.267377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:53.269087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:53.284315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 316/629] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:53.290328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:53.301012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561d50b-a9ad-4c7d-bfb7-c2113d434fca None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.350399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.351011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.351291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.351568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.352235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:53.352540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:53.354489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:53.369209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 314/630] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:53.374815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:53.417738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8312b-9057-4afb-9a04-06ddf40fd708 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.454991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.455707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.456055 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.456402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.457230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=6d66e92ebdd94630b887b31470be78ab) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:53.458154 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:53.459691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:53.475324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 317/631] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:53 2022] GET /identity/v3/role_assignments?user.id=6d66e92ebdd94630b887b31470be78ab&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:53.503334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359f486-1177-4053-b4e4-6868d01fcdb9 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.527104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:53.543972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.544674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.544894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.545160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.553751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:53.555346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:53.568461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:53.570363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:53.572268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 315/632] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:53.579429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:53.600245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:53.703887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195bcd0-d830-4ca3-a690-3f304e4d01dc None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.742521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851adf2-d9fa-4c44-813b-05398f43327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.743139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851adf2-d9fa-4c44-813b-05398f43327f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.743416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851adf2-d9fa-4c44-813b-05398f43327f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.743686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851adf2-d9fa-4c44-813b-05398f43327f None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.744413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851adf2-d9fa-4c44-813b-05398f43327f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:53.744722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851adf2-d9fa-4c44-813b-05398f43327f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:53.746201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851adf2-d9fa-4c44-813b-05398f43327f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:53.759489 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 318/633] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:53.765136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:53.782764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154def9-39d1-49d3-8b2d-8b161629fb6d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.783052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154def9-39d1-49d3-8b2d-8b161629fb6d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.783328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154def9-39d1-49d3-8b2d-8b161629fb6d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.784971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 319/634] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:53.790099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf4482-5028-4c8a-88af-d30408967448 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.790380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf4482-5028-4c8a-88af-d30408967448 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.790656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf4482-5028-4c8a-88af-d30408967448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.811621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-33cf4482-5028-4c8a-88af-d30408967448 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:53.812925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-33cf4482-5028-4c8a-88af-d30408967448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:53.872673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb65551-038b-4b99-a002-afb65730bece None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.907562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 320/635] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:53.922302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c2cef-0a36-4f30-a1c1-0d0beda6d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.923285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c2cef-0a36-4f30-a1c1-0d0beda6d1ec None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.923809 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c2cef-0a36-4f30-a1c1-0d0beda6d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.924266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c2cef-0a36-4f30-a1c1-0d0beda6d1ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.925230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c2cef-0a36-4f30-a1c1-0d0beda6d1ec None admin] RBAC: Adding query filter params (role.id=df5e47546621472692145fb33dc3d1a2, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=b9daad0debe14575922551c03889ac02) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:53.925784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c2cef-0a36-4f30-a1c1-0d0beda6d1ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:53.927537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c2cef-0a36-4f30-a1c1-0d0beda6d1ec None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:53.934357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 316/636] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:53 2022] GET /identity/v3/role_assignments?user.id=b9daad0debe14575922551c03889ac02&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=df5e47546621472692145fb33dc3d1a2 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:54.186747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf4482-5028-4c8a-88af-d30408967448 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:54.196367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:54.292861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf4482-5028-4c8a-88af-d30408967448 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.328414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6b02-ab66-4bcc-bc34-60e23bfb388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.329254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6b02-ab66-4bcc-bc34-60e23bfb388e None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.329704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6b02-ab66-4bcc-bc34-60e23bfb388e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.330116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6b02-ab66-4bcc-bc34-60e23bfb388e None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.330935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6b02-ab66-4bcc-bc34-60e23bfb388e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:54.332967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6b02-ab66-4bcc-bc34-60e23bfb388e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:54.349270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 321/637] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:47:54 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:55.455708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee704f-97d4-4b6c-8150-98aa6da2a61a None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.456261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee704f-97d4-4b6c-8150-98aa6da2a61a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.456261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee704f-97d4-4b6c-8150-98aa6da2a61a None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.457933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 317/638] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:55.463157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e588a0-b0e6-48ad-bbf0-30c227b1cca0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.463549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e588a0-b0e6-48ad-bbf0-30c227b1cca0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.463713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e588a0-b0e6-48ad-bbf0-30c227b1cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.482232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-49e588a0-b0e6-48ad-bbf0-30c227b1cca0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:55.483558 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-49e588a0-b0e6-48ad-bbf0-30c227b1cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:55.543348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:55.558242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 322/639] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:55 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:55.743473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ec89-2f23-4653-851d-3b3de433b610 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.743835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ec89-2f23-4653-851d-3b3de433b610 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.744203 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ec89-2f23-4653-851d-3b3de433b610 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.746071 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 318/640] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:55.758984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e98213-030e-4d5c-b5b6-7be5952f79f9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.759386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e98213-030e-4d5c-b5b6-7be5952f79f9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.759757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e98213-030e-4d5c-b5b6-7be5952f79f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.778393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c7e98213-030e-4d5c-b5b6-7be5952f79f9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:55.779569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c7e98213-030e-4d5c-b5b6-7be5952f79f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:55.834181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ec89-2f23-4653-851d-3b3de433b610 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:55.851268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 323/641] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:55 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:55.882046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:55.938515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ec89-2f23-4653-851d-3b3de433b610 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:55.984363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:55.985001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.985271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.987784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.987784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:55.987784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:55.997040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:55.998345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:47:55.999395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:56.001821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 319/642] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:56.007683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e98213-030e-4d5c-b5b6-7be5952f79f9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.117621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e98213-030e-4d5c-b5b6-7be5952f79f9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.121559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.142580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.155645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.156429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.156540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.156792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.157428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:56.157797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:56.159245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:56.169402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 324/643] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:56.170750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.240623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13ad0f-dd8d-4399-a614-2dab71c9f367 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.251505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.277541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc72da9-7535-41fa-a66b-6988859b7724 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.281888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5554c-5430-4e2a-b75a-bcf79e83ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.282713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5554c-5430-4e2a-b75a-bcf79e83ea52 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.283188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5554c-5430-4e2a-b75a-bcf79e83ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.283639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5554c-5430-4e2a-b75a-bcf79e83ea52 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.284399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5554c-5430-4e2a-b75a-bcf79e83ea52 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:56.286560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5554c-5430-4e2a-b75a-bcf79e83ea52 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-41c5554c-5430-4e2a-b75a-bcf79e83ea52 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:56.296998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:56.298048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:56.298900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 320/644] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:56.300160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5df590-b850-4db9-863d-88c36e653d9d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.300319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5df590-b850-4db9-863d-88c36e653d9d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.300583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5df590-b850-4db9-863d-88c36e653d9d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.302515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 321/645] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:56.307178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5df590-b850-4db9-863d-88c36e653d9d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.318972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985109e-80c0-4bef-9b83-26d531b8a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.319785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985109e-80c0-4bef-9b83-26d531b8a3fb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.319916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985109e-80c0-4bef-9b83-26d531b8a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.320114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985109e-80c0-4bef-9b83-26d531b8a3fb None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.320740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985109e-80c0-4bef-9b83-26d531b8a3fb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:56.321047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985109e-80c0-4bef-9b83-26d531b8a3fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:56.322424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985109e-80c0-4bef-9b83-26d531b8a3fb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:56.326967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 325/646] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:56.328170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d635c-c2f7-4011-80ef-6fc17ded8a0c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.328522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d635c-c2f7-4011-80ef-6fc17ded8a0c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.328859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d635c-c2f7-4011-80ef-6fc17ded8a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.349072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3e0d635c-c2f7-4011-80ef-6fc17ded8a0c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:56.350406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3e0d635c-c2f7-4011-80ef-6fc17ded8a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:56.409342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.442118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 326/647] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:56.452453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5df590-b850-4db9-863d-88c36e653d9d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.491148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd263482-2a5d-4100-9b84-e7a603a56da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.492650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd263482-2a5d-4100-9b84-e7a603a56da2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.493193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd263482-2a5d-4100-9b84-e7a603a56da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.493658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd263482-2a5d-4100-9b84-e7a603a56da2 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.494502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd263482-2a5d-4100-9b84-e7a603a56da2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:56.495043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd263482-2a5d-4100-9b84-e7a603a56da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:56.496634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd263482-2a5d-4100-9b84-e7a603a56da2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:56.502634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 322/648] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:56.510644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d635c-c2f7-4011-80ef-6fc17ded8a0c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.624393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d635c-c2f7-4011-80ef-6fc17ded8a0c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.646822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564158-29a8-4dab-93d8-461c63a47452 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.647114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564158-29a8-4dab-93d8-461c63a47452 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.647368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc564158-29a8-4dab-93d8-461c63a47452 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.648950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 323/649] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:56.653957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01b675-5bd8-4b4a-ab61-3cd48270869a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.654245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01b675-5bd8-4b4a-ab61-3cd48270869a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.654519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01b675-5bd8-4b4a-ab61-3cd48270869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.663004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.663854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.664313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.664785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.665647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:56.666131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:56.667684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:56.672588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ed01b675-5bd8-4b4a-ab61-3cd48270869a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:56.677567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ed01b675-5bd8-4b4a-ab61-3cd48270869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:56.677752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 327/650] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:56.710050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.747920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.761622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 324/651] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:47:56.800296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.863558 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429cd9-fafb-4eac-aff4-93b6ca35e6d9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.898826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991ce0-8ec7-4c55-8309-08615fab3098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.899461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991ce0-8ec7-4c55-8309-08615fab3098 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.899730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991ce0-8ec7-4c55-8309-08615fab3098 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.899994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991ce0-8ec7-4c55-8309-08615fab3098 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.910768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0991ce0-8ec7-4c55-8309-08615fab3098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-b0991ce0-8ec7-4c55-8309-08615fab3098 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:56.915963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:56.916891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:56.918189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 328/652] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:56.926591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01b675-5bd8-4b4a-ab61-3cd48270869a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.034363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991ce0-8ec7-4c55-8309-08615fab3098 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.045086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01b675-5bd8-4b4a-ab61-3cd48270869a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.081097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.081736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.082039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.082312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.083030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:57.083336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.084765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.098265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 325/653] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:57.099478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.134462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.159861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991ce0-8ec7-4c55-8309-08615fab3098 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.164142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.207569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.208546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.208828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.209096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.210353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.211744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:57.226197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:57.227184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:47:57.233243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 329/654] 10.222.0.47 () {56 vars in 1132 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:57.234782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a068b-41c2-441b-bb7c-a2d17ea5e0c6 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.234867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.277816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.278581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.278859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.279130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.292844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.294508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:57.314022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:57.315047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:57.315953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:57.315953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:57.315953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:57.317562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 326/655] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:57.321350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.371967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3881bb1-311c-4512-a6e1-c8dbaac44a76 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.413196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.413832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.414110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.414380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.415169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:57.415475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.417672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.425646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 330/656] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:57.429194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.434014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.456176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2348-498c-465c-b715-58b898689901 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.465646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.495654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.497035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.497562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.498031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.498956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:57.499452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.501065 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.514146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 327/657] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:57.519379 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.550439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32620df-e185-44fe-974e-2258b9778af8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.596559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.597840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.598581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.598852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.599864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:57.600173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.601818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.613661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 331/658] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:57.615524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.656469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb577a-713d-4a7a-852b-9e82afd6ab10 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.696410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.697612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.698034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.698636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.707381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.709683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.713433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:47:57.727818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:57.728836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:47:57.729822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:57.730355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.737534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 328/659] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:57.738374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.744720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677475b4-f15c-44f9-97bd-52882d420057 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.782133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.783108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.783683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.784152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.785073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] RBAC: Adding query filter params (interface=public, service_id=99535c9c16424f6da1329a91e281c265, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:57.786117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.787941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.796492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 332/660] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/endpoints?service_id=99535c9c16424f6da1329a91e281c265&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:57.803274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.859870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3ca87-9bad-4bc7-82f9-02aba4b9dc7d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.905461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.906573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.906945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.907310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.908246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:57.908643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.910349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.925333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470835c7-f488-4b9f-8520-369adc774f3b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.933521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 329/661] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:57.936896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.966183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99fc20-45a1-4e3e-8528-25168464bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.966878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99fc20-45a1-4e3e-8528-25168464bba7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.967156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99fc20-45a1-4e3e-8528-25168464bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.967427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99fc20-45a1-4e3e-8528-25168464bba7 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.968036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99fc20-45a1-4e3e-8528-25168464bba7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.969397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99fc20-45a1-4e3e-8528-25168464bba7 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.981887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 333/662] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/services => generated 1029 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:47:58.021065 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.067334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1350-f074-48b9-aff5-3540ff8f0a7a None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.104503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.105679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.106182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.106650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.119563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.121471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:58.138982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:58.139995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:58.140892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:58.140892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:58.140892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:58.143122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 330/663] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:58.151417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99fc20-45a1-4e3e-8528-25168464bba7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.179553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.259099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99fc20-45a1-4e3e-8528-25168464bba7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.294255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.294928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.295203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.295471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.296110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:58.296456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.297889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.311130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 334/664] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:58.316703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.426266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4a73-f21f-49bb-89ee-513f377ff2a7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.436889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.461872 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.462498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.462769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.463037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.469977 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.471414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:47:58.483279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:58.484452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:47:58.485386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 331/665] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:58.490950 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.579720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.598499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1315c3c-1177-4830-96c0-523a44199085 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.639433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45561991-1374-4ff9-b2dc-2658cdc1bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.640369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561991-1374-4ff9-b2dc-2658cdc1bca5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.640858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561991-1374-4ff9-b2dc-2658cdc1bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.641307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45561991-1374-4ff9-b2dc-2658cdc1bca5 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.642232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45561991-1374-4ff9-b2dc-2658cdc1bca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:58.642808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45561991-1374-4ff9-b2dc-2658cdc1bca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.644578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45561991-1374-4ff9-b2dc-2658cdc1bca5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.658550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 335/666] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.664101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.763117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd59f7-552a-4498-b7e9-8c87a5faa558 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.763832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd59f7-552a-4498-b7e9-8c87a5faa558 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.764321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd59f7-552a-4498-b7e9-8c87a5faa558 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.766393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 336/667] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:58.772126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f263002-8808-46c8-84c4-75b8b4d9cbed None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.772711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f263002-8808-46c8-84c4-75b8b4d9cbed None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.772956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a72d0d-84d3-4d2f-9489-b36e459c00bb None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.773384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f263002-8808-46c8-84c4-75b8b4d9cbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.794821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2f263002-8808-46c8-84c4-75b8b4d9cbed None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:58.797441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2f263002-8808-46c8-84c4-75b8b4d9cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:58.811900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dd7a5-f809-413a-8aa8-34d1b8afa639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.812612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dd7a5-f809-413a-8aa8-34d1b8afa639 None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.812884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dd7a5-f809-413a-8aa8-34d1b8afa639 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.813151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dd7a5-f809-413a-8aa8-34d1b8afa639 None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/b9daad0debe14575922551c03889ac02/roles/a83d4d004b014a17bad578f8f7b80062` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.815513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dd7a5-f809-413a-8aa8-34d1b8afa639 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=b9daad0debe14575922551c03889ac02, role_id=a83d4d004b014a17bad578f8f7b80062)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.817159 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dd7a5-f809-413a-8aa8-34d1b8afa639 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.837508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 332/668] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:58 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/b9daad0debe14575922551c03889ac02/roles/a83d4d004b014a17bad578f8f7b80062 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:58.891721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 337/669] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:58 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:47:58.909637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056c0b-518b-41e6-bbda-30af322e5e5c None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.909953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056c0b-518b-41e6-bbda-30af322e5e5c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.910245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056c0b-518b-41e6-bbda-30af322e5e5c None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.912445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 333/670] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:47:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:58.918268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5592-bdba-4877-a812-b4ff112079d4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.918609 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5592-bdba-4877-a812-b4ff112079d4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.918820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5592-bdba-4877-a812-b4ff112079d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.938360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6bcf5592-bdba-4877-a812-b4ff112079d4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:58.939583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6bcf5592-bdba-4877-a812-b4ff112079d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:59.018035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 338/671] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:58 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:47:59.178347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3056c0b-518b-41e6-bbda-30af322e5e5c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.211099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:59.286138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3056c0b-518b-41e6-bbda-30af322e5e5c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.298335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5592-bdba-4877-a812-b4ff112079d4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.302521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:59.323577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09feee1-7da1-4abc-bb84-58a2969233e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.324192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09feee1-7da1-4abc-bb84-58a2969233e5 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.324463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09feee1-7da1-4abc-bb84-58a2969233e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.324730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09feee1-7da1-4abc-bb84-58a2969233e5 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.325378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09feee1-7da1-4abc-bb84-58a2969233e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.326767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09feee1-7da1-4abc-bb84-58a2969233e5 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.356899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 334/672] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:47:59 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:59.429301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5592-bdba-4877-a812-b4ff112079d4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.476489 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b23b8-5856-4566-9559-5a24cf1e782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.477505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b23b8-5856-4566-9559-5a24cf1e782d None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.477995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b23b8-5856-4566-9559-5a24cf1e782d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.478447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b23b8-5856-4566-9559-5a24cf1e782d None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.479298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b23b8-5856-4566-9559-5a24cf1e782d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.480969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b23b8-5856-4566-9559-5a24cf1e782d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.499681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 339/673] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:47:59 2022] POST /identity/v3/services => generated 241 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:00.262387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac777e9-ae3d-42ef-a6ef-7f8c55cad3ef None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:00.263412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac777e9-ae3d-42ef-a6ef-7f8c55cad3ef None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:00.263914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac777e9-ae3d-42ef-a6ef-7f8c55cad3ef None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:00.265831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 335/674] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:00.272254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9d9ef-aa7a-4153-a22c-686662ece9c4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:00.273237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9d9ef-aa7a-4153-a22c-686662ece9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:00.273746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9d9ef-aa7a-4153-a22c-686662ece9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:00.295363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2ee9d9ef-aa7a-4153-a22c-686662ece9c4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:00.296891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2ee9d9ef-aa7a-4153-a22c-686662ece9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:00.355353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:00.381581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 340/675] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:00.649545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac777e9-ae3d-42ef-a6ef-7f8c55cad3ef None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:00.747603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:00.759831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac777e9-ae3d-42ef-a6ef-7f8c55cad3ef None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:00.795824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:00.796831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:00.797327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:00.797828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:00.798613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:00.800188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:00.809411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:00.810501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:00.811424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:00.817578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 336/676] 10.222.0.47 () {56 vars in 1132 bytes} [Fri Oct 14 12:48:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:00.820875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9d9ef-aa7a-4153-a22c-686662ece9c4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:00.922287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9d9ef-aa7a-4153-a22c-686662ece9c4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:00.961991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd508d-b47e-4724-b25e-f31f9b10bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:00.963004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd508d-b47e-4724-b25e-f31f9b10bd7f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:00.963489 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd508d-b47e-4724-b25e-f31f9b10bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:00.963971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd508d-b47e-4724-b25e-f31f9b10bd7f None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:00.964837 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd508d-b47e-4724-b25e-f31f9b10bd7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:00.965436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd508d-b47e-4724-b25e-f31f9b10bd7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:00.967070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd508d-b47e-4724-b25e-f31f9b10bd7f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:00.977570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 341/677] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:00.979179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:01.067469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd5c1-317a-4f46-81d2-6b2c78f1da35 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.068097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd5c1-317a-4f46-81d2-6b2c78f1da35 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.068583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd5c1-317a-4f46-81d2-6b2c78f1da35 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.070395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 342/678] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:01.075603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105e91-ec3a-4fed-8c5c-3be3548cf3d2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.076114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105e91-ec3a-4fed-8c5c-3be3548cf3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.076599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25105e91-ec3a-4fed-8c5c-3be3548cf3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.083211 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47af2a-1f50-4131-8bd6-d73abe24e713 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:01.099494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-25105e91-ec3a-4fed-8c5c-3be3548cf3d2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:01.101288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-25105e91-ec3a-4fed-8c5c-3be3548cf3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:01.123832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:01.124452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.124732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.125004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.125973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:01.126286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:01.127658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:01.137565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 337/679] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:01.140930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:01.168249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:01.169126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:01.201597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 343/680] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:01.263157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755dee-1513-4b6a-9f8f-e3af54268078 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:01.303091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f90468-7c2d-4b27-bad8-6147930fba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:01.303692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f90468-7c2d-4b27-bad8-6147930fba65 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.303962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f90468-7c2d-4b27-bad8-6147930fba65 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.304229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f90468-7c2d-4b27-bad8-6147930fba65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.304942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f90468-7c2d-4b27-bad8-6147930fba65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:01.306362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f90468-7c2d-4b27-bad8-6147930fba65 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:01.327049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 338/681] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:01.493967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105e91-ec3a-4fed-8c5c-3be3548cf3d2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:01.571059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f548922-4873-4391-a852-e4e93b117761 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.571341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f548922-4873-4391-a852-e4e93b117761 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.571616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f548922-4873-4391-a852-e4e93b117761 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.572954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 339/682] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:01.579431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25742-ac28-474f-a315-c5d9cd460c19 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.579834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25742-ac28-474f-a315-c5d9cd460c19 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.580114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25742-ac28-474f-a315-c5d9cd460c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.605417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25105e91-ec3a-4fed-8c5c-3be3548cf3d2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:01.626648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-42f25742-ac28-474f-a315-c5d9cd460c19 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:01.626648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-42f25742-ac28-474f-a315-c5d9cd460c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:01.661712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbbe5d-093d-4100-9878-28df52583507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:01.662448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbbe5d-093d-4100-9878-28df52583507 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.662727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbbe5d-093d-4100-9878-28df52583507 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.662994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbbe5d-093d-4100-9878-28df52583507 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.676023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbbe5d-093d-4100-9878-28df52583507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-79cbbe5d-093d-4100-9878-28df52583507 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:01.682318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:01.683485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:01.684773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 344/683] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Oct 14 12:48:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:01.689707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbbe5d-093d-4100-9878-28df52583507 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:01.715133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 340/684] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:01.716586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff86e-64c2-4445-9bb8-9b7a00eb6f69 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.716862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff86e-64c2-4445-9bb8-9b7a00eb6f69 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.717130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ff86e-64c2-4445-9bb8-9b7a00eb6f69 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.718596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 341/685] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:01.727271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bec82-8bb8-4982-9d41-a0a21cfff88c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.727821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bec82-8bb8-4982-9d41-a0a21cfff88c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.728246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bec82-8bb8-4982-9d41-a0a21cfff88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.737013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:01.744756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:01.752024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-585bec82-8bb8-4982-9d41-a0a21cfff88c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:01.753605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-585bec82-8bb8-4982-9d41-a0a21cfff88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:01.819511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbbe5d-093d-4100-9878-28df52583507 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:01.824090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 342/686] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:01.864514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:01.865529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:01.865808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:01.866083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:01.866752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:01.867058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:01.868541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:01.878708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 345/687] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Oct 14 12:48:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:01.884348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bec82-8bb8-4982-9d41-a0a21cfff88c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:01.995816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:01.998017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bec82-8bb8-4982-9d41-a0a21cfff88c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.035212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.036184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.036667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.037142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.039410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:02.049641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.051972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:02.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:02.068827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:02.069779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:02.069779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:02.069779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:02.071807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 343/688] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:02.077378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.122482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca96f2-af42-4ca4-aee2-b90441342e96 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.126616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:02.160763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.161388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.161688 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.161952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.162527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.163880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:02.172610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:02.173655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:02.174518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 346/689] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:02.175326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.195345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f0aec-3fe5-4f5e-9a7c-fab8ef8a3654 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.232294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.233007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.233283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.233582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.234477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:02.234776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.236122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.248495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 344/690] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:02.249208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.287729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba7a21-d717-44be-ae1f-705fd2718f09 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.304558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:02.328528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.329156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.329426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.329722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.330296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.331720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:02.340426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:02.341433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:02.342331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 347/691] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:02.343146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.369147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c17445-8052-459e-91ef-089c1c12bf4b None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.372660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:02.405636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.406232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.406504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.406770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.407391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:02.407748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.409127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.418979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 345/692] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:02.418979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.455249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513122b5-6d4a-41bc-af81-d8db4c9f76d0 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.491352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.492182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.492636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.493069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.500030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.501408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:02.515081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:02.516046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 348/693] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:02.517088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.527771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cc85a-22a0-453c-8a57-9fdfe61a5250 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.539460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:02.564935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.565560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.565833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.566098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.566750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:02.567051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.568399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.573052 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 346/694] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:02.573834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.617341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:02.631534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b494-b039-4621-8dc3-e3a077b90f08 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.669804 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.671189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.671874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.672319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.673368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:02.674203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.676336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.682979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 349/695] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:02.684007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.696973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554902a5-b08e-4f8f-809c-21baf731f3b7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.739843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.740469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.740729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.741077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.741837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:02.742146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.743560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.763139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 347/696] 10.222.0.47 () {56 vars in 1149 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:02.764529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.789110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815b06e-c4b4-422c-8803-66e728355dc7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.799029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:02.823891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.824500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.824781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.825054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.825783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:02.826006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.827364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.832230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 350/697] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:02.832994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.851496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:02.883368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79723139-e1cc-4bd3-934b-75285c3dd6cd None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.920344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.921165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.921275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.921474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.922185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] RBAC: Adding query filter params (interface=public, service_id=2461723731ed4a1faa31fe558aac3db0, region_id=RegionOne) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:02.922535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:02.923923 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:02.929496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 348/698] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/endpoints?service_id=2461723731ed4a1faa31fe558aac3db0&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:02.934769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:02.940799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2542c-2f79-4f89-9fdf-495577831063 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:02.983110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11b461-b3b0-4688-8022-094ef6dace74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:02.984473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11b461-b3b0-4688-8022-094ef6dace74 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.984473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11b461-b3b0-4688-8022-094ef6dace74 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.984636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11b461-b3b0-4688-8022-094ef6dace74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.034091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.041607 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b0b14-3da4-49e7-a9cd-84d8e1bbec5d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.055331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11b461-b3b0-4688-8022-094ef6dace74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.056788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11b461-b3b0-4688-8022-094ef6dace74 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:03.072641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.077937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:03.078543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.078818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.079401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.079865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] RBAC: Adding query filter params (interface=public, service_id=e2a6af21475f42ae8a0ae50af80bc580, region_id=RegionOne) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:03.080072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.081407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:03.086515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 349/699] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/endpoints?service_id=e2a6af21475f42ae8a0ae50af80bc580&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:03.091191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.166267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 351/700] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:48:03.167325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11b461-b3b0-4688-8022-094ef6dace74 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.196086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4611e-e788-45ed-a9ae-fd72544e24ee None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.230515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917b9eb-9528-41ad-83b9-d2311f499541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:03.231162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917b9eb-9528-41ad-83b9-d2311f499541 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.231436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917b9eb-9528-41ad-83b9-d2311f499541 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.231709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917b9eb-9528-41ad-83b9-d2311f499541 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.232309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917b9eb-9528-41ad-83b9-d2311f499541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.234015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917b9eb-9528-41ad-83b9-d2311f499541 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:03.240419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 350/701] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:48:03.241203 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917b9eb-9528-41ad-83b9-d2311f499541 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.277255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.296929 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11b461-b3b0-4688-8022-094ef6dace74 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.318494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.349817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25efe2-f372-40d8-b9ab-6523729b75b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:03.350458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25efe2-f372-40d8-b9ab-6523729b75b6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.350732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25efe2-f372-40d8-b9ab-6523729b75b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.351003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25efe2-f372-40d8-b9ab-6523729b75b6 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.351622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25efe2-f372-40d8-b9ab-6523729b75b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.353099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25efe2-f372-40d8-b9ab-6523729b75b6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:03.362603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 352/702] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:48:03.376158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917b9eb-9528-41ad-83b9-d2311f499541 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.417520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff25c5-5f3d-452f-96c6-ccc3e8df019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:03.418427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff25c5-5f3d-452f-96c6-ccc3e8df019a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.418883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff25c5-5f3d-452f-96c6-ccc3e8df019a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.419365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff25c5-5f3d-452f-96c6-ccc3e8df019a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.432791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff25c5-5f3d-452f-96c6-ccc3e8df019a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.434592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff25c5-5f3d-452f-96c6-ccc3e8df019a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-d8ff25c5-5f3d-452f-96c6-ccc3e8df019a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:03.452882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:03.454186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:03.455334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:03.455334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:03.455334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:03.457410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 351/703] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:03.463538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25efe2-f372-40d8-b9ab-6523729b75b6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.585451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25efe2-f372-40d8-b9ab-6523729b75b6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.606288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9302dd6-9a2a-4dea-9fd8-c2b4869719f6 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.606596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9302dd6-9a2a-4dea-9fd8-c2b4869719f6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.606825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9302dd6-9a2a-4dea-9fd8-c2b4869719f6 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.609558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 352/704] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:03.619780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9886-f17c-473f-8bf2-9f24e51a5496 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.620063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9886-f17c-473f-8bf2-9f24e51a5496 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.620335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9886-f17c-473f-8bf2-9f24e51a5496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.625200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:03.625844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.626122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.626393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.627035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:03.627337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.629289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:03.642237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 353/705] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:03.646130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-494d9886-f17c-473f-8bf2-9f24e51a5496 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:03.647424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-494d9886-f17c-473f-8bf2-9f24e51a5496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:03.647785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.699757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.725878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 353/706] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:03.775429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c5605-9b0b-4b9f-b443-1905ed7b329d None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.810571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:03.811460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.811893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.812316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.819821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.821575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:03.833373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:03.834504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:03.835703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:03.835703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:03.835703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:03.835703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:03.835703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:03.835703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:03.835703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:03.835703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:03.837772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 354/707] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:03.843622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d9886-f17c-473f-8bf2-9f24e51a5496 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.853055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.951716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d9886-f17c-473f-8bf2-9f24e51a5496 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.992039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:03.992924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.993408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.993938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.995003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:03.995511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.997175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.010312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 354/708] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:04.017527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.027303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.105000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.138075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.144119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41149e34-35a3-4ae6-b294-62b39ef21a9f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.147927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bba83f-6585-4def-9795-7f4f2a96bc9b None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.182056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.183171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.183734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.184280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.184582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.185216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.185505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.185781 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.186082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] RBAC: Adding query filter params (role.id=a83d4d004b014a17bad578f8f7b80062, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=b9daad0debe14575922551c03889ac02) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:04.186355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.186794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.187695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.188677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.195884 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 355/709] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/role_assignments?user.id=b9daad0debe14575922551c03889ac02&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=a83d4d004b014a17bad578f8f7b80062 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:04.198488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:04.199493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:04.200347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:04.208865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 355/710] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:04.210471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.333124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fca67b-a8fa-49ea-b35d-8f3f26dc02a4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.371608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d924f22-b608-47cf-9b1a-60b7cb88fd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.372634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924f22-b608-47cf-9b1a-60b7cb88fd29 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.373159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924f22-b608-47cf-9b1a-60b7cb88fd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.373672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d924f22-b608-47cf-9b1a-60b7cb88fd29 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.374532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d924f22-b608-47cf-9b1a-60b7cb88fd29 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:04.375036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d924f22-b608-47cf-9b1a-60b7cb88fd29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.376619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d924f22-b608-47cf-9b1a-60b7cb88fd29 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.383320 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 356/711] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:04.389211 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.493877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc89b4-242f-43f0-aa87-c863dcc1b732 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.523457 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.529409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a04f-9f4b-49f6-9999-0c0c6e5862f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.530111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a04f-9f4b-49f6-9999-0c0c6e5862f2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.530790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a04f-9f4b-49f6-9999-0c0c6e5862f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.531403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a04f-9f4b-49f6-9999-0c0c6e5862f2 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.532089 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a04f-9f4b-49f6-9999-0c0c6e5862f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:04.532630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a04f-9f4b-49f6-9999-0c0c6e5862f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.534360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a04f-9f4b-49f6-9999-0c0c6e5862f2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.539311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 356/712] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:05.539296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cc5a3-5ff2-4521-b08b-7dd1ae074f97 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.539842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cc5a3-5ff2-4521-b08b-7dd1ae074f97 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.539842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cc5a3-5ff2-4521-b08b-7dd1ae074f97 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.541399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 357/713] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:05.546800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8db4-214c-4f9c-bebd-5f935d9e7a95 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.547207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8db4-214c-4f9c-bebd-5f935d9e7a95 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.547374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc8db4-214c-4f9c-bebd-5f935d9e7a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.563041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7830-ff4b-4ea9-a74c-53796a6c80fb None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.563326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7830-ff4b-4ea9-a74c-53796a6c80fb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.563583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7830-ff4b-4ea9-a74c-53796a6c80fb None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.565134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 358/714] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:05.566552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-becc8db4-214c-4f9c-bebd-5f935d9e7a95 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:05.567754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-becc8db4-214c-4f9c-bebd-5f935d9e7a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:05.570223 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ca06-2a1a-4d5c-bb8b-985402f5b844 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.570498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ca06-2a1a-4d5c-bb8b-985402f5b844 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.570776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ca06-2a1a-4d5c-bb8b-985402f5b844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.588621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a922ca06-2a1a-4d5c-bb8b-985402f5b844 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:05.589815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a922ca06-2a1a-4d5c-bb8b-985402f5b844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:05.609862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:05.646919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 357/715] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:05.662923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 359/716] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:05.919406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc8db4-214c-4f9c-bebd-5f935d9e7a95 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:05.929637 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ca06-2a1a-4d5c-bb8b-985402f5b844 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:06.044222 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc8db4-214c-4f9c-bebd-5f935d9e7a95 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:06.052411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ca06-2a1a-4d5c-bb8b-985402f5b844 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:06.072569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:06.086395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:06.087160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.087558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.087935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.088631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:06.090119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:06.091911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:06.092786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.093276 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.093784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.094576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:06.096120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:06.100246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:06.101225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:06.102111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:06.105559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 358/717] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:06.107104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:06.114270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:06.115298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:06.116158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:06.120233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 360/718] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:06.121555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:06.149068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:06.226879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85b008-ea15-4d62-b38f-ebda98e715b5 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:06.243760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c25e5-b328-45a4-ab97-2dd9be2257f2 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:06.274811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:06.275419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.275690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.275953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.276581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:06.276881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:06.278264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:06.283428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 359/719] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:06.288173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:06.288895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:06.289113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.289558 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.289965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.290751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:06.291190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:06.292947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:06.303482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 361/720] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:06.304714 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:06.354872 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:06.407266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:06.414435 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc025f25-d3c6-4bd3-ae48-904e3a21f9db None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:06.426032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfac871-50e9-4000-835e-6b7c5b229213 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:06.454247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca2f6-9da9-42b9-93e6-366df47a5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:06.454853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca2f6-9da9-42b9-93e6-366df47a5e8f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.455127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca2f6-9da9-42b9-93e6-366df47a5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.455396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca2f6-9da9-42b9-93e6-366df47a5e8f None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.456032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ca2f6-9da9-42b9-93e6-366df47a5e8f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:06.456334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ca2f6-9da9-42b9-93e6-366df47a5e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:06.458250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ca2f6-9da9-42b9-93e6-366df47a5e8f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:06.461015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a8568-3d46-42e7-8969-1e6f8422af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:06.461641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8568-3d46-42e7-8969-1e6f8422af25 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.461915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8568-3d46-42e7-8969-1e6f8422af25 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.462185 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8568-3d46-42e7-8969-1e6f8422af25 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.462796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8568-3d46-42e7-8969-1e6f8422af25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:06.466146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8568-3d46-42e7-8969-1e6f8422af25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:06.466274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 360/721] 10.222.0.47 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:06.466274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5cc1e-7a80-4428-b249-b292d0ef400a None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.466457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8568-3d46-42e7-8969-1e6f8422af25 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:06.466541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5cc1e-7a80-4428-b249-b292d0ef400a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.466541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5cc1e-7a80-4428-b249-b292d0ef400a None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.466541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 361/722] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:06.470288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5cc1e-7a80-4428-b249-b292d0ef400a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:06.473195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 362/723] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:06.474553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb91a2-fb60-4a57-95de-8cc846b050f8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.475008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb91a2-fb60-4a57-95de-8cc846b050f8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.475430 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb91a2-fb60-4a57-95de-8cc846b050f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.493929 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f0fb91a2-fb60-4a57-95de-8cc846b050f8 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:06.495024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f0fb91a2-fb60-4a57-95de-8cc846b050f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:06.569506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 363/724] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:06.569506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb91a2-fb60-4a57-95de-8cc846b050f8 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:06.588850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5cc1e-7a80-4428-b249-b292d0ef400a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:06.606976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:06.626147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e87a6c-99f7-44a6-a9dc-814c78c68afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:06.626902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e87a6c-99f7-44a6-a9dc-814c78c68afa None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.627291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e87a6c-99f7-44a6-a9dc-814c78c68afa None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.627652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e87a6c-99f7-44a6-a9dc-814c78c68afa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.628404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e87a6c-99f7-44a6-a9dc-814c78c68afa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:06.630697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e87a6c-99f7-44a6-a9dc-814c78c68afa None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:06.652856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:06.658453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 362/725] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:06.681699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb91a2-fb60-4a57-95de-8cc846b050f8 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:06.728069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb3d6e-3ed8-4408-981b-876792b82b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:06.728689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb3d6e-3ed8-4408-981b-876792b82b55 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.728966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb3d6e-3ed8-4408-981b-876792b82b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.729234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb3d6e-3ed8-4408-981b-876792b82b55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.729940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb3d6e-3ed8-4408-981b-876792b82b55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:06.731497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb3d6e-3ed8-4408-981b-876792b82b55 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:06.761545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 364/726] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:06.778841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2f21-4f12-40b7-ae8e-53d8a3d9178b None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.779171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2f21-4f12-40b7-ae8e-53d8a3d9178b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.779377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b2f21-4f12-40b7-ae8e-53d8a3d9178b None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.781137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 363/727] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:06.787192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1214-ce06-4e5e-a4fd-bd265565a597 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.787524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1214-ce06-4e5e-a4fd-bd265565a597 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.787757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b1214-ce06-4e5e-a4fd-bd265565a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.807748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1f4b1214-ce06-4e5e-a4fd-bd265565a597 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:06.808980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1f4b1214-ce06-4e5e-a4fd-bd265565a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:06.859532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2f21-4f12-40b7-ae8e-53d8a3d9178b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:06.900080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 365/728] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:06.984462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b2f21-4f12-40b7-ae8e-53d8a3d9178b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:07.021296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:07.021868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.022147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.022416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] PATH_INFO: `/v3/services/image` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.023000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:07.024349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:07.034080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:07.035166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:07.036602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 364/729] 10.222.0.47 () {56 vars in 1105 bytes} [Fri Oct 14 12:48:06 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:07.043447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1214-ce06-4e5e-a4fd-bd265565a597 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:07.099756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:07.152244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b1214-ce06-4e5e-a4fd-bd265565a597 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:07.188187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:07.188801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.189076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.189347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.190007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] RBAC: Adding query filter params (name=image) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:07.190417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:07.191817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:07.192205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:07.197225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 366/730] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:07.202514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:07.231468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:07.298263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2aab2-d4d8-4c74-b103-a003f298392d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:07.321003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665366a-f34c-44ce-bd20-2028e81d5543 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:07.334793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f9475-2647-4752-a530-cf2410a70e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:07.335403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9475-2647-4752-a530-cf2410a70e35 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.335679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9475-2647-4752-a530-cf2410a70e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.335946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f9475-2647-4752-a530-cf2410a70e35 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.336598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f9475-2647-4752-a530-cf2410a70e35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:07.338011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f9475-2647-4752-a530-cf2410a70e35 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:07.345235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:07.360451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 365/731] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:07 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:07.380050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9872e-57d8-4fe4-b54b-750256207a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:07.380786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9872e-57d8-4fe4-b54b-750256207a7d None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.381060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9872e-57d8-4fe4-b54b-750256207a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.381327 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9872e-57d8-4fe4-b54b-750256207a7d None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.382092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9872e-57d8-4fe4-b54b-750256207a7d None admin] RBAC: Adding query filter params (type=image) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:07.382396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9872e-57d8-4fe4-b54b-750256207a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:07.383865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9872e-57d8-4fe4-b54b-750256207a7d None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:07.389965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 367/732] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:08.997730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756d19b-e2d3-43c0-ac34-1550a873cbf5 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.998216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756d19b-e2d3-43c0-ac34-1550a873cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.998328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756d19b-e2d3-43c0-ac34-1550a873cbf5 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.999738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 366/733] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:09.005102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417cbc-7299-445f-b70e-f803707a332d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.005960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417cbc-7299-445f-b70e-f803707a332d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.006442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417cbc-7299-445f-b70e-f803707a332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.025313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-46417cbc-7299-445f-b70e-f803707a332d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:09.026850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-46417cbc-7299-445f-b70e-f803707a332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:09.048812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccde3c-d1fa-45be-b4b3-6467f079cd58 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.049429 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccde3c-d1fa-45be-b4b3-6467f079cd58 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.049940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccde3c-d1fa-45be-b4b3-6467f079cd58 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.051812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 367/734] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:09.059254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678cf75-c9e3-4b35-bb96-25944eb2f58c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.059880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678cf75-c9e3-4b35-bb96-25944eb2f58c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.060359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678cf75-c9e3-4b35-bb96-25944eb2f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.083217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a678cf75-c9e3-4b35-bb96-25944eb2f58c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:09.085231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a678cf75-c9e3-4b35-bb96-25944eb2f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:09.109509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 368/735] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:09.155149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 368/736] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:09.373158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46417cbc-7299-445f-b70e-f803707a332d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.442252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678cf75-c9e3-4b35-bb96-25944eb2f58c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.474840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.481643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46417cbc-7299-445f-b70e-f803707a332d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.494902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.525681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.526312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.526585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.526852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.527519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.529025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.531916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING keystone.server.flask.common [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 14 12:48:09.551848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.sql.core [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:09.551848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:48:09.551848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [parameters: {'id': 'bc948516e61b445f8300b8cd23b6bc78', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 14 12:48:09.551848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc948516e61b445f8300b8cd23b6bc78.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc948516e61b445f8300b8cd23b6bc78. Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:09.559992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 12:48:09.560895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application yield resource Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise self.value Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application session.commit() Oct 14 12:48:09.561899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:48:09.562829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:48:09.564647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:09.567128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [parameters: {'id': 'bc948516e61b445f8300b8cd23b6bc78', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.569275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.571534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc948516e61b445f8300b8cd23b6bc78. Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 369/737] 10.222.0.47 () {60 vars in 1140 bytes} [Fri Oct 14 12:48:09 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:09.577684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.681303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db23d7-ab3f-47be-9384-e07778f17c00 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.713653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dceead5-d6c2-4195-96a4-77b35547031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.714273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceead5-d6c2-4195-96a4-77b35547031f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.714544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceead5-d6c2-4195-96a4-77b35547031f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.714640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678cf75-c9e3-4b35-bb96-25944eb2f58c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.714812 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceead5-d6c2-4195-96a4-77b35547031f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.721149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dceead5-d6c2-4195-96a4-77b35547031f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.723316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dceead5-d6c2-4195-96a4-77b35547031f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-9dceead5-d6c2-4195-96a4-77b35547031f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:09.735741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:09.736610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:09.737560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 370/738] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:09.738626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e307d-d83b-4b1c-966f-6fc849471733 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.738823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e307d-d83b-4b1c-966f-6fc849471733 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.739341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e307d-d83b-4b1c-966f-6fc849471733 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.743042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 371/739] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:09.744051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd4a93-ab3c-413b-9a0c-2b262bed6630 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.744409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd4a93-ab3c-413b-9a0c-2b262bed6630 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.744671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd4a93-ab3c-413b-9a0c-2b262bed6630 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.745868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 372/740] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:09.746542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd4a93-ab3c-413b-9a0c-2b262bed6630 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.756261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bb27e-fd51-4e7f-80cd-ca94bb2dfd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.756891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb27e-fd51-4e7f-80cd-ca94bb2dfd1b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.757169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb27e-fd51-4e7f-80cd-ca94bb2dfd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.757439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bb27e-fd51-4e7f-80cd-ca94bb2dfd1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.758094 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bb27e-fd51-4e7f-80cd-ca94bb2dfd1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.759445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bb27e-fd51-4e7f-80cd-ca94bb2dfd1b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-449bb27e-fd51-4e7f-80cd-ca94bb2dfd1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.768057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:09.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:09.769973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 369/741] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:09.770779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cff63-d8be-4ae6-8039-b77d92790077 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.770779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cff63-d8be-4ae6-8039-b77d92790077 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.770779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cff63-d8be-4ae6-8039-b77d92790077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.775978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.790176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-377cff63-d8be-4ae6-8039-b77d92790077 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:09.791366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-377cff63-d8be-4ae6-8039-b77d92790077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:09.852455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd4a93-ab3c-413b-9a0c-2b262bed6630 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.857722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 370/742] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:09.859176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bfb7-a5b4-4055-9655-e5518332f3af None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.859453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bfb7-a5b4-4055-9655-e5518332f3af None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.859718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200bfb7-a5b4-4055-9655-e5518332f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.879142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5200bfb7-a5b4-4055-9655-e5518332f3af None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:09.880905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5200bfb7-a5b4-4055-9655-e5518332f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:09.887106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.887710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.887983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.888248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.888897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:09.889195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.890656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.896513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.908316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 373/743] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:09.909377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.969669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 371/744] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:10.018193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.031958 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dff352-106b-4eff-8ccd-626e50f37683 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.071484 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0893-8409-4650-8484-91004049d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.072190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0893-8409-4650-8484-91004049d85b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.072465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0893-8409-4650-8484-91004049d85b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.072733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0893-8409-4650-8484-91004049d85b None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.073616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0893-8409-4650-8484-91004049d85b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.073928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0893-8409-4650-8484-91004049d85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.075318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0893-8409-4650-8484-91004049d85b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.081237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 374/745] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:10.087747 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200bfb7-a5b4-4055-9655-e5518332f3af None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.127712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0893-8409-4650-8484-91004049d85b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.214122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200bfb7-a5b4-4055-9655-e5518332f3af None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.251788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0893-8409-4650-8484-91004049d85b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.252669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.253302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.254164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.254431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.255253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.255558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.257758 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.263479 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 372/746] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:10.270520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.286411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.297240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763ac9-904f-4858-a082-7588ff67d502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.297872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763ac9-904f-4858-a082-7588ff67d502 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.298138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763ac9-904f-4858-a082-7588ff67d502 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.298403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67763ac9-904f-4858-a082-7588ff67d502 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.299048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763ac9-904f-4858-a082-7588ff67d502 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.300942 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67763ac9-904f-4858-a082-7588ff67d502 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.317877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 375/747] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:10 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:10.318500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763ac9-904f-4858-a082-7588ff67d502 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.335158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.399713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bba841-e049-4b6c-8428-f07ce878701d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.450225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.451124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.451236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.451529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.452367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] RBAC: Adding query filter params (interface=admin, service_id=e2a6af21475f42ae8a0ae50af80bc580, region_id=RegionOne) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.452556 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.453981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.455724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67763ac9-904f-4858-a082-7588ff67d502 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.465165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 373/748] 10.222.0.47 () {56 vars in 1249 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/endpoints?service_id=e2a6af21475f42ae8a0ae50af80bc580&interface=admin®ion_id=RegionOne => generated 193 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:10.466186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.497251 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.498429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.498978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.499583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.500369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.502316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:10.512387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:10.513580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:10.514652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:10.516746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 376/749] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:10.522991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.556504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.599419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1970d-4c41-40f5-aa85-3fb6aa77a937 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.616635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.644810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7cb43-0188-44f4-90ea-47b7614b6766 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.645302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974cb83-4b3f-4910-93fc-832dcfd9b7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.646024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974cb83-4b3f-4910-93fc-832dcfd9b7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.646373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974cb83-4b3f-4910-93fc-832dcfd9b7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.646719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974cb83-4b3f-4910-93fc-832dcfd9b7d3 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.647680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974cb83-4b3f-4910-93fc-832dcfd9b7d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.650085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974cb83-4b3f-4910-93fc-832dcfd9b7d3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.657308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 374/750] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:48:10.695733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.696679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.697207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.697682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.698508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.698993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.700692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.707729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 377/751] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:10.714733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974cb83-4b3f-4910-93fc-832dcfd9b7d3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.827426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974cb83-4b3f-4910-93fc-832dcfd9b7d3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.868618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.869246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.869551 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.869828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.870472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.870779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.872154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.879013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 375/752] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:10.885159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.002805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c350713-fa4d-471f-a09a-055f7ff1af8e None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.036933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35f11-f12f-47a2-9420-dae2db7feccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.037592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35f11-f12f-47a2-9420-dae2db7feccf None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.037848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35f11-f12f-47a2-9420-dae2db7feccf None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.038112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35f11-f12f-47a2-9420-dae2db7feccf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.038803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35f11-f12f-47a2-9420-dae2db7feccf None admin] RBAC: Adding query filter params (interface=public, service_id=af7034dfe4aa4b4ebdc35d2865a250ee, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:11.039103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35f11-f12f-47a2-9420-dae2db7feccf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.040511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c35f11-f12f-47a2-9420-dae2db7feccf None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.045938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 378/753] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/endpoints?service_id=af7034dfe4aa4b4ebdc35d2865a250ee&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:11.051886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.055032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:11.154743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8220f-ee68-466e-b7b7-86d0d4d397d1 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.195215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd38966-54f1-4bd6-a81f-2daa552d05be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.195824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd38966-54f1-4bd6-a81f-2daa552d05be None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.196100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd38966-54f1-4bd6-a81f-2daa552d05be None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.196367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd38966-54f1-4bd6-a81f-2daa552d05be None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.196976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd38966-54f1-4bd6-a81f-2daa552d05be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.198360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd38966-54f1-4bd6-a81f-2daa552d05be None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.205319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 376/754] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:48:12.277141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485ecc2-3373-47de-82b1-38bbb590e322 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.277646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485ecc2-3373-47de-82b1-38bbb590e322 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.277646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485ecc2-3373-47de-82b1-38bbb590e322 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.279246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 379/755] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:12.284774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38510a3a-9ada-42e4-ab55-bf1283a5f249 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.285162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38510a3a-9ada-42e4-ab55-bf1283a5f249 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.285327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38510a3a-9ada-42e4-ab55-bf1283a5f249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.303822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-38510a3a-9ada-42e4-ab55-bf1283a5f249 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:12.305006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-38510a3a-9ada-42e4-ab55-bf1283a5f249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:12.370630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:12.378670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 377/756] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:12.612328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a0f5-804a-415d-a9b4-bdd5f7dcc365 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.612756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a0f5-804a-415d-a9b4-bdd5f7dcc365 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.612961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a0f5-804a-415d-a9b4-bdd5f7dcc365 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.614547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 380/757] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:12.619992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1ad9e-1dbf-43fd-8e04-6cd2aa4dedb0 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.620275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1ad9e-1dbf-43fd-8e04-6cd2aa4dedb0 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.620550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1ad9e-1dbf-43fd-8e04-6cd2aa4dedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.639417 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2dd1ad9e-1dbf-43fd-8e04-6cd2aa4dedb0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:12.640592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2dd1ad9e-1dbf-43fd-8e04-6cd2aa4dedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:12.654817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76a0f5-804a-415d-a9b4-bdd5f7dcc365 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:12.657695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:12.710844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 378/758] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:12.766167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76a0f5-804a-415d-a9b4-bdd5f7dcc365 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:12.805738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14111b-6ef3-4ce8-97b0-1b202278e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:12.806365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14111b-6ef3-4ce8-97b0-1b202278e6e2 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.806642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14111b-6ef3-4ce8-97b0-1b202278e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.806911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14111b-6ef3-4ce8-97b0-1b202278e6e2 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.807584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14111b-6ef3-4ce8-97b0-1b202278e6e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:12.809058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14111b-6ef3-4ce8-97b0-1b202278e6e2 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:12.824741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.sql.core [None req-de14111b-6ef3-4ce8-97b0-1b202278e6e2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 12:48:12.824741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 14 12:48:12.824741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [parameters: {'user_id': '78960658e98c4aec9f9e94feabafaba4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 14 12:48:12.824741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-de14111b-6ef3-4ce8-97b0-1b202278e6e2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:12.832229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:12.833151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application yield resource Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise self.value Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application session.commit() Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:48:12.834168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:48:12.835061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:12.835952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:12.836790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [parameters: {'user_id': '78960658e98c4aec9f9e94feabafaba4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:12.838684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 14 12:48:12.840749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 14 12:48:12.850072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 14 12:48:12.850072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 14 12:48:12.850072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:48:12.850072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:48:12.850072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 14 12:48:12.850072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:12.850072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 381/759] 10.222.0.47 () {60 vars in 1131 bytes} [Fri Oct 14 12:48:12 2022] POST /identity/v3/users => generated 160 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:12.851032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1ad9e-1dbf-43fd-8e04-6cd2aa4dedb0 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:12.907307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014664-dbbf-4d64-b48e-61cffdfcd06a None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.907589 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014664-dbbf-4d64-b48e-61cffdfcd06a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.907773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014664-dbbf-4d64-b48e-61cffdfcd06a None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.914074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 382/760] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:12.923602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39f394-ef16-4a9e-bebd-f5d6ea6996bd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.924005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39f394-ef16-4a9e-bebd-f5d6ea6996bd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.924380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39f394-ef16-4a9e-bebd-f5d6ea6996bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.949671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9f39f394-ef16-4a9e-bebd-f5d6ea6996bd None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:12.952057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9f39f394-ef16-4a9e-bebd-f5d6ea6996bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:12.957070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1ad9e-1dbf-43fd-8e04-6cd2aa4dedb0 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:12.984467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:12.994953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:12.995892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.996362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.996825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.004338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.006027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:13.017694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:13.018628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:48:13.020165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:13.023039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 379/761] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:13.023605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.030436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.040912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 383/762] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:13.041585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39f394-ef16-4a9e-bebd-f5d6ea6996bd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.146543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a3be-b723-4956-bb11-42dc517014b1 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.162360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39f394-ef16-4a9e-bebd-f5d6ea6996bd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.181304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.181979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.182254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.182528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] PATH_INFO: `/v3/services/image` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.183193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.184565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:13.193981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:13.194970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:13.195826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:13.199865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 380/763] 10.222.0.47 () {56 vars in 1105 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:13.200709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.209896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.211215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.211741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.212204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.213552 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:13.214092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.216513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.254221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.270058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 384/764] 10.222.0.47 () {56 vars in 1101 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:13.307371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.331684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e284c9a-f9a8-46e1-93ac-d1519b36738d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.371418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.378051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.379201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.379477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.379746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.380398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] RBAC: Adding query filter params (name=image) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:13.380804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.382482 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.393688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 381/765] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:13.394756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.435975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a903f-82b9-4734-b8c9-53d0433e8c14 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.477201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca69788-2a82-4b42-8f10-3d487839a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.478790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69788-2a82-4b42-8f10-3d487839a3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.478790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69788-2a82-4b42-8f10-3d487839a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.478790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69788-2a82-4b42-8f10-3d487839a3e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.479078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca69788-2a82-4b42-8f10-3d487839a3e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.480314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca69788-2a82-4b42-8f10-3d487839a3e0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-5ca69788-2a82-4b42-8f10-3d487839a3e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:13.491164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:13.492181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:13.493042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 385/766] 10.222.0.47 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:13.493873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab972e-a1fd-4e17-ba65-64f230c51dd3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.493873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab972e-a1fd-4e17-ba65-64f230c51dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.494003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab972e-a1fd-4e17-ba65-64f230c51dd3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.500185 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 386/767] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:13.501001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab972e-a1fd-4e17-ba65-64f230c51dd3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.529949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8f465-e0e6-4010-8ec0-a02ed42d5c88 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.546142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.571429 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa14c8c-38e3-48b9-a112-34cdcc4d9b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.572038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14c8c-38e3-48b9-a112-34cdcc4d9b46 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.572312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14c8c-38e3-48b9-a112-34cdcc4d9b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.572574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa14c8c-38e3-48b9-a112-34cdcc4d9b46 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.573199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa14c8c-38e3-48b9-a112-34cdcc4d9b46 None admin] RBAC: Adding query filter params (type=image) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:13.573521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa14c8c-38e3-48b9-a112-34cdcc4d9b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.574873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa14c8c-38e3-48b9-a112-34cdcc4d9b46 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.579469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 382/768] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:13.580572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1530b3-5080-4e30-8350-1db91c789e05 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.580849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1530b3-5080-4e30-8350-1db91c789e05 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.581131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1530b3-5080-4e30-8350-1db91c789e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.599229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-7c1530b3-5080-4e30-8350-1db91c789e05 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:13.600564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7c1530b3-5080-4e30-8350-1db91c789e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:13.622823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab972e-a1fd-4e17-ba65-64f230c51dd3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.639400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.656915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.657534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.657808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.658073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.658689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:13.658984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.660865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.665701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 387/769] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:13.666450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.672162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 383/770] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:13 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:13.672860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1530b3-5080-4e30-8350-1db91c789e05 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.766255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ea3d-109c-4fbf-b789-49810a4eb668 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.784828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1530b3-5080-4e30-8350-1db91c789e05 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.794627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.802425 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.803037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.803313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.803586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.804274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] RBAC: Adding query filter params (interface=public, service_id=b1e533fff92c43b0a6a9edc31ee0d227, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:13.804578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.805981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.811132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 388/771] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/endpoints?service_id=b1e533fff92c43b0a6a9edc31ee0d227&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:13.816474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.825912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.826723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.827175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.827516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.828148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:13.828679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.829810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.835347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 384/772] 10.222.0.47 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:13.840752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.863268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.917288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328bb04-e309-40ec-bd35-33100ecd6b75 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.948233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663da90f-3756-4074-9d6d-e8ea38a0c7a4 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.950869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f159794-bb6f-4dd8-8d46-8433e9bd9ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.951544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f159794-bb6f-4dd8-8d46-8433e9bd9ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.951827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f159794-bb6f-4dd8-8d46-8433e9bd9ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.952096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f159794-bb6f-4dd8-8d46-8433e9bd9ed1 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.952693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f159794-bb6f-4dd8-8d46-8433e9bd9ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:13.954077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f159794-bb6f-4dd8-8d46-8433e9bd9ed1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:13.960340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 389/773] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 12:48:13.961097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f159794-bb6f-4dd8-8d46-8433e9bd9ed1 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.000195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ef78-1771-4f83-a6c8-59c46b5e4c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.000916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ef78-1771-4f83-a6c8-59c46b5e4c3c None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.001194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ef78-1771-4f83-a6c8-59c46b5e4c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.001509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8ef78-1771-4f83-a6c8-59c46b5e4c3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.002175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8ef78-1771-4f83-a6c8-59c46b5e4c3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.004127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8ef78-1771-4f83-a6c8-59c46b5e4c3c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.023779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 385/774] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:14.208462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f159794-bb6f-4dd8-8d46-8433e9bd9ed1 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.219585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:14.254056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.254914 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.255343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.255605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.256168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.257560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:14.266414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:14.267444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:14.268298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:14.272441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 390/775] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:14.273918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ef78-1771-4f83-a6c8-59c46b5e4c3c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.306954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:14.379196 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8ef78-1771-4f83-a6c8-59c46b5e4c3c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.414915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.415517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.415791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.416060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.416694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:14.416994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.418370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.427803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 386/776] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:14.429339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.529864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e0806-3ebd-4784-8af6-6fca4a74898a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.564712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c683d3-de1e-4839-b3ea-2c2c47f5ff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.565335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c683d3-de1e-4839-b3ea-2c2c47f5ff34 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.565668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c683d3-de1e-4839-b3ea-2c2c47f5ff34 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.565941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c683d3-de1e-4839-b3ea-2c2c47f5ff34 None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.566563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c683d3-de1e-4839-b3ea-2c2c47f5ff34 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:14.566862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c683d3-de1e-4839-b3ea-2c2c47f5ff34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.568223 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c683d3-de1e-4839-b3ea-2c2c47f5ff34 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.577717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 391/777] 10.222.0.47 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:14.578687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.677470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:14.684037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298f70d-a321-4a2b-9f9c-264ef09736d2 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.717561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166623f-c8e0-4cb8-b143-0057de8a4641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.718171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166623f-c8e0-4cb8-b143-0057de8a4641 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.718445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166623f-c8e0-4cb8-b143-0057de8a4641 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.718710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166623f-c8e0-4cb8-b143-0057de8a4641 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.719368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166623f-c8e0-4cb8-b143-0057de8a4641 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.720729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166623f-c8e0-4cb8-b143-0057de8a4641 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.749541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 387/778] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:16.171323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e0ef0-78ee-4644-a516-2028fc9768fd None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.171860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e0ef0-78ee-4644-a516-2028fc9768fd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.171860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e0ef0-78ee-4644-a516-2028fc9768fd None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.173516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 392/779] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:16.179132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cc5b2-ee7b-4b2b-b8b8-64a7020b57d3 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.179539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cc5b2-ee7b-4b2b-b8b8-64a7020b57d3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.179711 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cc5b2-ee7b-4b2b-b8b8-64a7020b57d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.199444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-468cc5b2-ee7b-4b2b-b8b8-64a7020b57d3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:16.200623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-468cc5b2-ee7b-4b2b-b8b8-64a7020b57d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:16.206661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae86560-35d9-4a59-98b3-ebb693882c9c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.206938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae86560-35d9-4a59-98b3-ebb693882c9c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.207202 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae86560-35d9-4a59-98b3-ebb693882c9c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.208658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 393/780] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:16.213376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeeaf5-5c1d-4889-a542-8413cdbf08e9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.213679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeeaf5-5c1d-4889-a542-8413cdbf08e9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.213954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeeaf5-5c1d-4889-a542-8413cdbf08e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.239019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-babeeaf5-5c1d-4889-a542-8413cdbf08e9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:16.240116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-babeeaf5-5c1d-4889-a542-8413cdbf08e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:16.266965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.290841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 388/781] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:16.315540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 394/782] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:16.561019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cc5b2-ee7b-4b2b-b8b8-64a7020b57d3 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.580279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeeaf5-5c1d-4889-a542-8413cdbf08e9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.647004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.675787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cc5b2-ee7b-4b2b-b8b8-64a7020b57d3 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.684904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeeaf5-5c1d-4889-a542-8413cdbf08e9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.711417 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.712048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.712324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.712595 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] PATH_INFO: `/v3/services/image` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.713174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.714567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.720876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a5dd4-db55-443c-958c-adb2b5fbe6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.721704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a5dd4-db55-443c-958c-adb2b5fbe6cb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.722749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a5dd4-db55-443c-958c-adb2b5fbe6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.723160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a5dd4-db55-443c-958c-adb2b5fbe6cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.724378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a5dd4-db55-443c-958c-adb2b5fbe6cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:16.724502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:16.725661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:16.726724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:16.729084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a5dd4-db55-443c-958c-adb2b5fbe6cb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.730265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 389/783] 10.222.0.47 () {56 vars in 1105 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:16.730967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 395/784] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:16.731660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.736819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a5dd4-db55-443c-958c-adb2b5fbe6cb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.766439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.840541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da317c7d-0252-43ce-a5ed-cf6eb9240d48 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.845254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a5dd4-db55-443c-958c-adb2b5fbe6cb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.879839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.880471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.880756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.881086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.881795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] RBAC: Adding query filter params (name=image) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:16.882057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.883399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.883780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385f17e-585e-4ef2-a82e-fba0fe35c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.884380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f17e-585e-4ef2-a82e-fba0fe35c410 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.884653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f17e-585e-4ef2-a82e-fba0fe35c410 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.884918 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385f17e-585e-4ef2-a82e-fba0fe35c410 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.885592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385f17e-585e-4ef2-a82e-fba0fe35c410 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.886984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385f17e-585e-4ef2-a82e-fba0fe35c410 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.888665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 390/785] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:16.894454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.903713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.922113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 396/786] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:16 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:16.958997 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ad91-1d4b-404f-897d-646cba3536a0 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.959279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ad91-1d4b-404f-897d-646cba3536a0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.959545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ad91-1d4b-404f-897d-646cba3536a0 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.960872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 397/787] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:16.966657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3db0a-2e63-4381-a71e-343466659c63 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.967193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3db0a-2e63-4381-a71e-343466659c63 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.967643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3db0a-2e63-4381-a71e-343466659c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.994536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e3f3db0a-2e63-4381-a71e-343466659c63 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:16.996007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e3f3db0a-2e63-4381-a71e-343466659c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:17.013286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87175366-a5cc-414e-9032-2a7830f6da99 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.054092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.054707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.054980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.055245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.055883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.056188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.057591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.063183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 391/788] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:17.069638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.076234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 398/789] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:17.143764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.176158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f557782-9243-45b2-aaac-e37efc85b8f2 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.211295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ad01-3619-4782-bfc5-02de095ceaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.212026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ad01-3619-4782-bfc5-02de095ceaf8 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.212231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ad01-3619-4782-bfc5-02de095ceaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.212504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ad01-3619-4782-bfc5-02de095ceaf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.213160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83ad01-3619-4782-bfc5-02de095ceaf8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.214548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83ad01-3619-4782-bfc5-02de095ceaf8 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.241557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 392/790] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:17.346632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3db0a-2e63-4381-a71e-343466659c63 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.361529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.459601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3db0a-2e63-4381-a71e-343466659c63 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.499473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec6b7e-27aa-4605-88d3-0befa6a8e565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.500101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6b7e-27aa-4605-88d3-0befa6a8e565 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.500369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6b7e-27aa-4605-88d3-0befa6a8e565 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.500631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6b7e-27aa-4605-88d3-0befa6a8e565 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.511393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec6b7e-27aa-4605-88d3-0befa6a8e565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-37ec6b7e-27aa-4605-88d3-0befa6a8e565 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:17.516114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:17.517071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:17.518044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 399/791] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:17.523609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ad01-3619-4782-bfc5-02de095ceaf8 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.623307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ad01-3619-4782-bfc5-02de095ceaf8 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.650220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.660855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.661460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.661760 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.662026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.662690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.662991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.664333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.678671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 393/792] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:17.680225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec6b7e-27aa-4605-88d3-0befa6a8e565 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.749723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.784053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec6b7e-27aa-4605-88d3-0befa6a8e565 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.819206 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.819827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.820098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.820364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.830527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.831989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:17.846048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:17.847509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:17.848415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:17.848415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:17.848415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:17.848415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 400/793] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:17.853623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.952896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13a6df-264a-482a-9783-ca699175d917 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.993694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.994581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.995033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.995471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.996309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.996741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.998246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.010057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 394/794] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:18.015559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.116748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1fbd9-9f15-4595-a6bd-0adc7d8a1756 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.138038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.155081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.156033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.156485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.156960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.166197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.167856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:18.179170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:18.180100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:18.181069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:18.185604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 401/795] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:18.188158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.241420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.292964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9983-a514-47d8-bb68-e197fd22d96c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.326998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.327592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.327866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.328132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.328843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:18.329144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.330576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.347311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 395/796] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:18.352878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.458646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbd370-5e90-4822-8f91-151f97e62d47 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.492741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.493368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.493688 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.493956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.505118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.506587 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:18.520759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:18.521995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:18.522915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:18.522915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:18.522915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:18.525560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 402/797] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:18.527505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.628905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b103f-b6d4-4b13-b330-b8faadc4db62 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.636689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.665144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.665807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.666083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.666356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.666992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:18.667290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.668631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.680415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 396/798] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:18.685883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.716685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.786402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77933990-7d12-42cf-abf4-d7c9a0f2b6b9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.825252 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.825903 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.826173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.826438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.833709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.835141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:18.846057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:18.847006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:18.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:18.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:18.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:18.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:18.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:18.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:18.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:18.847897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:18.848886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 403/799] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:18.852905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.952027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831400-0a79-42a0-af4b-30654772b7b2 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.994195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b19e7e-fdde-4a37-9a20-b169584f8f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.994797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19e7e-fdde-4a37-9a20-b169584f8f9d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.995069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19e7e-fdde-4a37-9a20-b169584f8f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.995333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19e7e-fdde-4a37-9a20-b169584f8f9d None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.996016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b19e7e-fdde-4a37-9a20-b169584f8f9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:18.996313 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b19e7e-fdde-4a37-9a20-b169584f8f9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.997761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b19e7e-fdde-4a37-9a20-b169584f8f9d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.010300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 397/800] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:19.016119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.111385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.121857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f03e4-9977-439c-aa7a-ee300363ada5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.155376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fd076-5841-4d02-ba97-1ac37e071ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.156033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fd076-5841-4d02-ba97-1ac37e071ec3 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.156306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fd076-5841-4d02-ba97-1ac37e071ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.156571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fd076-5841-4d02-ba97-1ac37e071ec3 None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/d360b800645041cf8caa43dcc0116761/roles/a83d4d004b014a17bad578f8f7b80062` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.158686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fd076-5841-4d02-ba97-1ac37e071ec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=d360b800645041cf8caa43dcc0116761, role_id=a83d4d004b014a17bad578f8f7b80062)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.160131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fd076-5841-4d02-ba97-1ac37e071ec3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.167072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02deee3-2a68-4226-b7fd-423e1fd9707a None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.167502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02deee3-2a68-4226-b7fd-423e1fd9707a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.167744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02deee3-2a68-4226-b7fd-423e1fd9707a None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.169154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 398/801] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:19.174350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 404/802] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:19 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/d360b800645041cf8caa43dcc0116761/roles/a83d4d004b014a17bad578f8f7b80062 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:19.175553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af57f-967d-468c-a231-793429dcfce2 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.176092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af57f-967d-468c-a231-793429dcfce2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.176561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9af57f-967d-468c-a231-793429dcfce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.196117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0d9af57f-967d-468c-a231-793429dcfce2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:19.197688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0d9af57f-967d-468c-a231-793429dcfce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:19.221111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.275715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 399/803] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:19.449366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96151ff7-6437-4e2d-b108-6031f971cc15 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.449944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96151ff7-6437-4e2d-b108-6031f971cc15 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.449944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96151ff7-6437-4e2d-b108-6031f971cc15 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.451429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 405/804] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:19.456926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a566682-6f6a-4e41-86fe-c30b35fca88d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.457217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a566682-6f6a-4e41-86fe-c30b35fca88d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.457505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a566682-6f6a-4e41-86fe-c30b35fca88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.475648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0a566682-6f6a-4e41-86fe-c30b35fca88d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:19.476759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0a566682-6f6a-4e41-86fe-c30b35fca88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:19.541859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96151ff7-6437-4e2d-b108-6031f971cc15 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.543837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 400/805] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:19.642181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96151ff7-6437-4e2d-b108-6031f971cc15 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.676714 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c167faf-1e9e-4a16-989e-30bbc2067003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.677336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c167faf-1e9e-4a16-989e-30bbc2067003 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.677631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c167faf-1e9e-4a16-989e-30bbc2067003 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.677897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c167faf-1e9e-4a16-989e-30bbc2067003 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.678990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c167faf-1e9e-4a16-989e-30bbc2067003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.680409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c167faf-1e9e-4a16-989e-30bbc2067003 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.682228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 406/806] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:19.687586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a566682-6f6a-4e41-86fe-c30b35fca88d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.770952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.787106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a566682-6f6a-4e41-86fe-c30b35fca88d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.810504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c167faf-1e9e-4a16-989e-30bbc2067003 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.820125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2d9a-c0ea-4c00-96b1-f3bc54c5d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.820718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2d9a-c0ea-4c00-96b1-f3bc54c5d4a8 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.820991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2d9a-c0ea-4c00-96b1-f3bc54c5d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.821256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab2d9a-c0ea-4c00-96b1-f3bc54c5d4a8 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.821992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab2d9a-c0ea-4c00-96b1-f3bc54c5d4a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.823350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab2d9a-c0ea-4c00-96b1-f3bc54c5d4a8 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.834136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.847600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 401/807] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:19 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:19.936383 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c167faf-1e9e-4a16-989e-30bbc2067003 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.972644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.973272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.977616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.977616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.977616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.977616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.990336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.sql.core [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:19.990336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:48:19.990336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [parameters: {'id': 'f4e2107ec68d4d559eb98b3ab3e84224', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 12:48:19.990336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:19.997878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 12:48:19.998800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application yield resource Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise self.value Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application session.commit() Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:48:20.002290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:48:20.003261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:48:20.004275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:20.005092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [parameters: {'id': 'f4e2107ec68d4d559eb98b3ab3e84224', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 12:48:20.006181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:20.007204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:20.008296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 407/808] 10.222.0.47 () {60 vars in 1137 bytes} [Fri Oct 14 12:48:19 2022] POST /identity/v3/domains => generated 190 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:20.010392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2d9a-c0ea-4c00-96b1-f3bc54c5d4a8 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.120936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab2d9a-c0ea-4c00-96b1-f3bc54c5d4a8 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.154782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c206e-e03f-46e2-baf4-2bfb2afd341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.155410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c206e-e03f-46e2-baf4-2bfb2afd341d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.155688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c206e-e03f-46e2-baf4-2bfb2afd341d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.155955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c206e-e03f-46e2-baf4-2bfb2afd341d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.166479 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c206e-e03f-46e2-baf4-2bfb2afd341d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.167915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c206e-e03f-46e2-baf4-2bfb2afd341d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.169644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-482c206e-e03f-46e2-baf4-2bfb2afd341d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:20.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:20.185296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:20.186588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:20.186588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:20.186588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:20.189246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 402/809] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:20.194680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.279399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.296632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a5ec1-98bf-4bcd-833e-725c2a3f4e40 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.330517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85f3c7-9a01-48fe-ae9c-bc7755912682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.331703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f3c7-9a01-48fe-ae9c-bc7755912682 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.331981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f3c7-9a01-48fe-ae9c-bc7755912682 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.332250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85f3c7-9a01-48fe-ae9c-bc7755912682 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.332884 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85f3c7-9a01-48fe-ae9c-bc7755912682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:20.333183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85f3c7-9a01-48fe-ae9c-bc7755912682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.334584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85f3c7-9a01-48fe-ae9c-bc7755912682 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.346189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 408/810] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:21.330755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c439a-4512-465d-9e35-9ecb83909996 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.331785 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c439a-4512-465d-9e35-9ecb83909996 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.331785 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c439a-4512-465d-9e35-9ecb83909996 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.333019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 403/811] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:21.338260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41611a7d-9c0b-446f-add9-b7c9d51791e6 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.338697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41611a7d-9c0b-446f-add9-b7c9d51791e6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.338797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41611a7d-9c0b-446f-add9-b7c9d51791e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.356871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-41611a7d-9c0b-446f-add9-b7c9d51791e6 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:21.358044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-41611a7d-9c0b-446f-add9-b7c9d51791e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:21.421635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 409/812] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:21.687399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c439a-4512-465d-9e35-9ecb83909996 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:21.786419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c439a-4512-465d-9e35-9ecb83909996 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.818770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686013e6-c444-4d36-aa15-7f9422c8d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:21.819385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686013e6-c444-4d36-aa15-7f9422c8d1aa None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.819659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686013e6-c444-4d36-aa15-7f9422c8d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.819924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686013e6-c444-4d36-aa15-7f9422c8d1aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.829678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686013e6-c444-4d36-aa15-7f9422c8d1aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-686013e6-c444-4d36-aa15-7f9422c8d1aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:21.834475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:21.835652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:21.837034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 404/813] 10.222.0.47 () {56 vars in 1120 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:21.841556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41611a7d-9c0b-446f-add9-b7c9d51791e6 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:21.916307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:21.943205 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41611a7d-9c0b-446f-add9-b7c9d51791e6 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.981170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe600010-592c-4a8a-8b53-71cb3260cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:21.981825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe600010-592c-4a8a-8b53-71cb3260cab4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.982097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe600010-592c-4a8a-8b53-71cb3260cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.982365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe600010-592c-4a8a-8b53-71cb3260cab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.983024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe600010-592c-4a8a-8b53-71cb3260cab4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:21.983323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe600010-592c-4a8a-8b53-71cb3260cab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:21.984949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe600010-592c-4a8a-8b53-71cb3260cab4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:21.993830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 410/814] 10.222.0.47 () {56 vars in 1115 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:21.999635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686013e6-c444-4d36-aa15-7f9422c8d1aa None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.019947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340880-d160-4a7a-8e74-20461186e904 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.020228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340880-d160-4a7a-8e74-20461186e904 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.020499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340880-d160-4a7a-8e74-20461186e904 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.021833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 411/815] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:22.026622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8b0a-a8a0-4e44-9430-d6948f0e6f8d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.026906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8b0a-a8a0-4e44-9430-d6948f0e6f8d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.027177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8b0a-a8a0-4e44-9430-d6948f0e6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.044550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-76ab8b0a-a8a0-4e44-9430-d6948f0e6f8d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:22.045816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-76ab8b0a-a8a0-4e44-9430-d6948f0e6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:22.057778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.103202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686013e6-c444-4d36-aa15-7f9422c8d1aa None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.113510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 412/816] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:22.136966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.137610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.137887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.138152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.147851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.149274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:22.163209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:22.168928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:22.170103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:22.170103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:22.170103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:22.170103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 405/817] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:22.170388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab8b0a-a8a0-4e44-9430-d6948f0e6f8d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.232135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.266596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab8b0a-a8a0-4e44-9430-d6948f0e6f8d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.298269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.298861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.299134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.299401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.300559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:22.300857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.302245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.312932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 413/818] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:22.318571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.378398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.415558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7076a-6084-48f8-b118-f210992f0e2a None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.422775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.450911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.451528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.451805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.452065 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.458857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.460263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:22.472355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:22.473371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:22.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 406/819] 10.222.0.47 () {56 vars in 1093 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:22.478598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79120b31-60fa-46d1-8198-dac5b375fb3f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.479117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.504151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.513243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187908d-6d66-48b0-b5e7-f1727e93ce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.513893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187908d-6d66-48b0-b5e7-f1727e93ce9b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.514168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187908d-6d66-48b0-b5e7-f1727e93ce9b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.514496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187908d-6d66-48b0-b5e7-f1727e93ce9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.525974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187908d-6d66-48b0-b5e7-f1727e93ce9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-6187908d-6d66-48b0-b5e7-f1727e93ce9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:22.530699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:22.531805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:22.532686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 414/820] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:22.537695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187908d-6d66-48b0-b5e7-f1727e93ce9b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.578470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0819d-ba20-4a79-9d69-9b4d8446fbc1 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.612324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.612927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.613205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.613474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.614231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:22.614538 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.615964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.633432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 407/821] 10.222.0.47 () {56 vars in 1133 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:22.639076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.641654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187908d-6d66-48b0-b5e7-f1727e93ce9b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.663215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.676013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.676618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.676892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.677159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.677851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:22.678155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.679528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.687920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 415/822] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:22.693790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.737141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d6e51-f4bd-48c1-803d-d58499d6838c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.741134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.771516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1e8e8-ef4b-41b6-a02b-cdca255d5949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.772211 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e8e8-ef4b-41b6-a02b-cdca255d5949 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.772489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e8e8-ef4b-41b6-a02b-cdca255d5949 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.773109 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1e8e8-ef4b-41b6-a02b-cdca255d5949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.790698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ffe32-e41e-41c2-910c-4e1eccd23fa5 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.824349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02e29-0baa-4f19-93c1-499fc60a5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.824973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02e29-0baa-4f19-93c1-499fc60a5fdd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.825250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02e29-0baa-4f19-93c1-499fc60a5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.825549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02e29-0baa-4f19-93c1-499fc60a5fdd None admin] PATH_INFO: `/v3/users/06f7e07f3bcc471cb11fbce3ffa7221e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.839328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c02e29-0baa-4f19-93c1-499fc60a5fdd None admin] RBAC: Authorizing `identity:get_user(user_id=06f7e07f3bcc471cb11fbce3ffa7221e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.839777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1e8e8-ef4b-41b6-a02b-cdca255d5949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.840747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c02e29-0baa-4f19-93c1-499fc60a5fdd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.841193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1e8e8-ef4b-41b6-a02b-cdca255d5949 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.849052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 416/823] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/users/06f7e07f3bcc471cb11fbce3ffa7221e => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:22.850143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02e29-0baa-4f19-93c1-499fc60a5fdd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.865883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.939344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 408/824] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 14 12:48:22.944864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1e8e8-ef4b-41b6-a02b-cdca255d5949 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.948722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02e29-0baa-4f19-93c1-499fc60a5fdd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.957228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.985057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5699d-ac5d-42a0-b046-a90c0671a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.985716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5699d-ac5d-42a0-b046-a90c0671a64a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.985986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5699d-ac5d-42a0-b046-a90c0671a64a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.986250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5699d-ac5d-42a0-b046-a90c0671a64a None admin] PATH_INFO: `/v3/projects/858a79c07de9485495f713af97704855` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.987975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5699d-ac5d-42a0-b046-a90c0671a64a None admin] RBAC: Authorizing `identity:get_project(project_id=858a79c07de9485495f713af97704855)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.989415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5699d-ac5d-42a0-b046-a90c0671a64a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.991060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 417/825] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/projects/858a79c07de9485495f713af97704855 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:22.996705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5699d-ac5d-42a0-b046-a90c0671a64a None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.044918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1e8e8-ef4b-41b6-a02b-cdca255d5949 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.068458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.079340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.079955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.080226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.080489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.090264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.091673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.092606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5699d-ac5d-42a0-b046-a90c0671a64a None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:23.106278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:23.107421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:23.108362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:23.108362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:23.108362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:23.108362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 409/826] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:23.113440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.127447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cd55-e6dc-473b-a9b7-4041883463bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.128740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cd55-e6dc-473b-a9b7-4041883463bd None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.129020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cd55-e6dc-473b-a9b7-4041883463bd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.129293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4cd55-e6dc-473b-a9b7-4041883463bd None admin] PATH_INFO: `/v3/projects/858a79c07de9485495f713af97704855/users/06f7e07f3bcc471cb11fbce3ffa7221e/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.131275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4cd55-e6dc-473b-a9b7-4041883463bd None admin] RBAC: Authorizing `identity:create_grant(project_id=858a79c07de9485495f713af97704855, user_id=06f7e07f3bcc471cb11fbce3ffa7221e, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.132698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4cd55-e6dc-473b-a9b7-4041883463bd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.145652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 418/827] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:22 2022] PUT /identity/v3/projects/858a79c07de9485495f713af97704855/users/06f7e07f3bcc471cb11fbce3ffa7221e/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:48:23.216368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae4e7-5dc1-4e5e-8321-aa9351421aab None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.250770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.251380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.251653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.251917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.252565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:23.253386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.254783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.267734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 410/828] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:23.274385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cd55-e6dc-473b-a9b7-4041883463bd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.309784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.376136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4cd55-e6dc-473b-a9b7-4041883463bd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.410203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.410994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.411271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.411542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.418105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.419542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:23.430969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:23.431976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:23.432899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 419/829] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:23.437990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.472522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.536154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbcf16-0405-48de-8304-2164cf42d26c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.568531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062440ae-fb06-402a-80a6-6222b54e0004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.569064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062440ae-fb06-402a-80a6-6222b54e0004 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.569341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062440ae-fb06-402a-80a6-6222b54e0004 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.569648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062440ae-fb06-402a-80a6-6222b54e0004 None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.570337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062440ae-fb06-402a-80a6-6222b54e0004 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:23.570642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062440ae-fb06-402a-80a6-6222b54e0004 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.572053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062440ae-fb06-402a-80a6-6222b54e0004 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.583646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 411/830] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:23.589959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.681324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.688333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605e2b0-8377-470b-8b75-74708e4c6de3 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.721162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b7082-f3e9-4936-b7fb-274c15a416af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.722327 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7082-f3e9-4936-b7fb-274c15a416af None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.722599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7082-f3e9-4936-b7fb-274c15a416af None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.722865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b7082-f3e9-4936-b7fb-274c15a416af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.723580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b7082-f3e9-4936-b7fb-274c15a416af None admin] RBAC: Adding query filter params (role.id=a83d4d004b014a17bad578f8f7b80062, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=d360b800645041cf8caa43dcc0116761) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:23.723883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b7082-f3e9-4936-b7fb-274c15a416af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.725291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b7082-f3e9-4936-b7fb-274c15a416af None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.730950 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 420/831] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/role_assignments?user.id=d360b800645041cf8caa43dcc0116761&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=a83d4d004b014a17bad578f8f7b80062 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:25.272749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb23f0-7484-4053-b4d8-df6d2880aa21 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.273246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb23f0-7484-4053-b4d8-df6d2880aa21 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.273246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb23f0-7484-4053-b4d8-df6d2880aa21 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.274562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 412/832] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:25.279669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced49a2-4c66-4dc3-82fa-0f113b1c25a4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.280076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced49a2-4c66-4dc3-82fa-0f113b1c25a4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.280311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced49a2-4c66-4dc3-82fa-0f113b1c25a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.298657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-eced49a2-4c66-4dc3-82fa-0f113b1c25a4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:25.299960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-eced49a2-4c66-4dc3-82fa-0f113b1c25a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:25.363806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 421/833] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:25.629991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb23f0-7484-4053-b4d8-df6d2880aa21 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:25.722562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:25.729277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb23f0-7484-4053-b4d8-df6d2880aa21 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:25.761283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c4e82-a64a-40cc-9a70-eb88b898b5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:25.761938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c4e82-a64a-40cc-9a70-eb88b898b5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.762212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c4e82-a64a-40cc-9a70-eb88b898b5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.762478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c4e82-a64a-40cc-9a70-eb88b898b5f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.772674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c4e82-a64a-40cc-9a70-eb88b898b5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-324c4e82-a64a-40cc-9a70-eb88b898b5f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:25.777393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:25.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:25.779585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 413/834] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:25.785262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced49a2-4c66-4dc3-82fa-0f113b1c25a4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:25.869350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:25.881351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced49a2-4c66-4dc3-82fa-0f113b1c25a4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:25.914221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:25.914813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.915088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.915356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.916012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:25.916330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:25.917696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:25.926048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 422/835] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:25.931848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c4e82-a64a-40cc-9a70-eb88b898b5f8 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:26.029039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c4e82-a64a-40cc-9a70-eb88b898b5f8 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:26.061688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5f5ba-892e-4777-a983-45409a5771c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:26.062301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5f5ba-892e-4777-a983-45409a5771c4 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:26.062578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5f5ba-892e-4777-a983-45409a5771c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:26.062846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5f5ba-892e-4777-a983-45409a5771c4 None admin] PATH_INFO: `/v3/users/06f7e07f3bcc471cb11fbce3ffa7221e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:26.063957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5f5ba-892e-4777-a983-45409a5771c4 None admin] RBAC: Authorizing `identity:get_user(user_id=06f7e07f3bcc471cb11fbce3ffa7221e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:26.065905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5f5ba-892e-4777-a983-45409a5771c4 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:26.067499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 414/836] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:25 2022] GET /identity/v3/users/06f7e07f3bcc471cb11fbce3ffa7221e => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:26.073139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:26.169892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6da67-3b2a-40f7-8c6a-57b7505dfd62 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:26.202060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3e17-69ee-4a79-bd21-6a4679caf7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:26.202647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3e17-69ee-4a79-bd21-6a4679caf7cf None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:26.202924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3e17-69ee-4a79-bd21-6a4679caf7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:26.203193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b3e17-69ee-4a79-bd21-6a4679caf7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:26.220679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:26.269063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b3e17-69ee-4a79-bd21-6a4679caf7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:26.270522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b3e17-69ee-4a79-bd21-6a4679caf7cf None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:26.363645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 423/837] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:48:26.369440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5f5ba-892e-4777-a983-45409a5771c4 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:26.394907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:26.466182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5f5ba-892e-4777-a983-45409a5771c4 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:26.499129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212f97d-34d3-4379-a0fc-707c47fea85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:26.499739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212f97d-34d3-4379-a0fc-707c47fea85a None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:26.500018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212f97d-34d3-4379-a0fc-707c47fea85a None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:26.500286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212f97d-34d3-4379-a0fc-707c47fea85a None admin] PATH_INFO: `/v3/projects/858a79c07de9485495f713af97704855` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:26.501381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212f97d-34d3-4379-a0fc-707c47fea85a None admin] RBAC: Authorizing `identity:get_project(project_id=858a79c07de9485495f713af97704855)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:26.503379 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212f97d-34d3-4379-a0fc-707c47fea85a None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:26.504972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 415/838] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:48:26 2022] GET /identity/v3/projects/858a79c07de9485495f713af97704855 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:26.511092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3e17-69ee-4a79-bd21-6a4679caf7cf None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:26.558514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:26.606294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b3e17-69ee-4a79-bd21-6a4679caf7cf None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:26.640081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625179e1-ea58-42f2-9307-0219e6f96637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:26.640675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625179e1-ea58-42f2-9307-0219e6f96637 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:26.640953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625179e1-ea58-42f2-9307-0219e6f96637 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:26.641221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625179e1-ea58-42f2-9307-0219e6f96637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:26.641971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625179e1-ea58-42f2-9307-0219e6f96637 None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=858a79c07de9485495f713af97704855, user.id=06f7e07f3bcc471cb11fbce3ffa7221e) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:26.642281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625179e1-ea58-42f2-9307-0219e6f96637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:26.643765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625179e1-ea58-42f2-9307-0219e6f96637 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:26.649350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 424/839] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:26 2022] GET /identity/v3/role_assignments?user.id=06f7e07f3bcc471cb11fbce3ffa7221e&scope.project.id=858a79c07de9485495f713af97704855&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:28.753692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8ee41-e3b0-48ff-9907-efd3dd22a086 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.754248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8ee41-e3b0-48ff-9907-efd3dd22a086 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.754248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8ee41-e3b0-48ff-9907-efd3dd22a086 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.755538 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 416/840] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:28.760807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154a14-8d5d-4589-8105-8d6692d6b2ec None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.761176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154a14-8d5d-4589-8105-8d6692d6b2ec None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.761350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154a14-8d5d-4589-8105-8d6692d6b2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.779632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-31154a14-8d5d-4589-8105-8d6692d6b2ec None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:28.780841 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-31154a14-8d5d-4589-8105-8d6692d6b2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:28.844288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 425/841] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:29.116397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8ee41-e3b0-48ff-9907-efd3dd22a086 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.204398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.214405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8ee41-e3b0-48ff-9907-efd3dd22a086 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.246322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35222bda-3668-4d90-ac0d-17487e7e767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.246927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35222bda-3668-4d90-ac0d-17487e7e767c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.247199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35222bda-3668-4d90-ac0d-17487e7e767c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.247465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35222bda-3668-4d90-ac0d-17487e7e767c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.248546 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35222bda-3668-4d90-ac0d-17487e7e767c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.249986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35222bda-3668-4d90-ac0d-17487e7e767c None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.251491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 417/842] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:29.257594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31154a14-8d5d-4589-8105-8d6692d6b2ec None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.300824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.352553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31154a14-8d5d-4589-8105-8d6692d6b2ec None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.385772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4adff-05a4-4a83-88ae-22bdd4f8f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.386305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4adff-05a4-4a83-88ae-22bdd4f8f181 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.386577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4adff-05a4-4a83-88ae-22bdd4f8f181 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.386844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4adff-05a4-4a83-88ae-22bdd4f8f181 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.387490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4adff-05a4-4a83-88ae-22bdd4f8f181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.388896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4adff-05a4-4a83-88ae-22bdd4f8f181 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.412922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 426/843] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:29 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:31.529966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83161fb-4cb9-4546-9ba1-12d9306abe65 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.530514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83161fb-4cb9-4546-9ba1-12d9306abe65 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.530514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83161fb-4cb9-4546-9ba1-12d9306abe65 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.531820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 418/844] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:31.537548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74d8c9-217b-4e08-a360-3f8597cba217 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.537967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74d8c9-217b-4e08-a360-3f8597cba217 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.538094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74d8c9-217b-4e08-a360-3f8597cba217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.556365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5d74d8c9-217b-4e08-a360-3f8597cba217 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:31.557564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5d74d8c9-217b-4e08-a360-3f8597cba217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:31.621053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 427/845] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:31.892386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83161fb-4cb9-4546-9ba1-12d9306abe65 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:31.993001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83161fb-4cb9-4546-9ba1-12d9306abe65 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:32.025650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d650e-0d81-4537-80d4-ae84bb4a9659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:32.026270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d650e-0d81-4537-80d4-ae84bb4a9659 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.026549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d650e-0d81-4537-80d4-ae84bb4a9659 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.026822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d650e-0d81-4537-80d4-ae84bb4a9659 None admin] PATH_INFO: `/v3/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.028209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d650e-0d81-4537-80d4-ae84bb4a9659 None admin] RBAC: Authorizing `identity:get_role(role_id=7d7ee6a7e93f46e5bff0a079bfb7ea3e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:32.029594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d650e-0d81-4537-80d4-ae84bb4a9659 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:32.030891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 419/846] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:31 2022] GET /identity/v3/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:32.037158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74d8c9-217b-4e08-a360-3f8597cba217 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:32.065860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:32.133382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74d8c9-217b-4e08-a360-3f8597cba217 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:32.166027 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e559cf-7663-4bcb-8241-d5c5abfc80e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:32.166590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e559cf-7663-4bcb-8241-d5c5abfc80e8 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.166868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e559cf-7663-4bcb-8241-d5c5abfc80e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.167138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e559cf-7663-4bcb-8241-d5c5abfc80e8 None admin] PATH_INFO: `/v3/users/f3555e4a48604d9a82c17adf35871fd1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.179594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e559cf-7663-4bcb-8241-d5c5abfc80e8 None admin] RBAC: Authorizing `identity:get_user(user_id=f3555e4a48604d9a82c17adf35871fd1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:32.181026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e559cf-7663-4bcb-8241-d5c5abfc80e8 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:32.182618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 428/847] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:32 2022] GET /identity/v3/users/f3555e4a48604d9a82c17adf35871fd1 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:32.188258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d650e-0d81-4537-80d4-ae84bb4a9659 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:32.217323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:32.285837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d650e-0d81-4537-80d4-ae84bb4a9659 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:32.317789 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b167cf5-7521-451f-b2d0-ca98a8081f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:32.318402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167cf5-7521-451f-b2d0-ca98a8081f2f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.318679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167cf5-7521-451f-b2d0-ca98a8081f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.318957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b167cf5-7521-451f-b2d0-ca98a8081f2f None admin] PATH_INFO: `/v3/projects/858a79c07de9485495f713af97704855` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.320062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b167cf5-7521-451f-b2d0-ca98a8081f2f None admin] RBAC: Authorizing `identity:get_project(project_id=858a79c07de9485495f713af97704855)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:32.321474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b167cf5-7521-451f-b2d0-ca98a8081f2f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:32.323092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 420/848] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:48:32 2022] GET /identity/v3/projects/858a79c07de9485495f713af97704855 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:32.328820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e559cf-7663-4bcb-8241-d5c5abfc80e8 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:32.413354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:32.425664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e559cf-7663-4bcb-8241-d5c5abfc80e8 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:32.457905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ffd97-1530-465b-bcdc-9b732aa995f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:32.458546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ffd97-1530-465b-bcdc-9b732aa995f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.458821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ffd97-1530-465b-bcdc-9b732aa995f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.459091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ffd97-1530-465b-bcdc-9b732aa995f9 None admin] PATH_INFO: `/v3/projects/858a79c07de9485495f713af97704855/users/f3555e4a48604d9a82c17adf35871fd1/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.461180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ffd97-1530-465b-bcdc-9b732aa995f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=858a79c07de9485495f713af97704855, user_id=f3555e4a48604d9a82c17adf35871fd1, role_id=7d7ee6a7e93f46e5bff0a079bfb7ea3e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:32.462629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ffd97-1530-465b-bcdc-9b732aa995f9 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:32.475000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 429/849] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:32 2022] PUT /identity/v3/projects/858a79c07de9485495f713af97704855/users/f3555e4a48604d9a82c17adf35871fd1/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:34.559288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ed8a-69e1-4869-aaad-eb985d09c5b2 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.559288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ed8a-69e1-4869-aaad-eb985d09c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.559288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8ed8a-69e1-4869-aaad-eb985d09c5b2 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.560323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 421/850] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:34.566144 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092350c-11a9-40b3-b8c7-ca027ab3111e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.566508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092350c-11a9-40b3-b8c7-ca027ab3111e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.566687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092350c-11a9-40b3-b8c7-ca027ab3111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.585040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c092350c-11a9-40b3-b8c7-ca027ab3111e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:34.586246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c092350c-11a9-40b3-b8c7-ca027ab3111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:34.650722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 430/851] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:34.917877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8ed8a-69e1-4869-aaad-eb985d09c5b2 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:35.010912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:35.017614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8ed8a-69e1-4869-aaad-eb985d09c5b2 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:35.048860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293054bd-3941-4cc0-a7ab-2668ccd4081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:35.050038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293054bd-3941-4cc0-a7ab-2668ccd4081b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.050312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293054bd-3941-4cc0-a7ab-2668ccd4081b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.050580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293054bd-3941-4cc0-a7ab-2668ccd4081b None admin] PATH_INFO: `/v3/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.051949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293054bd-3941-4cc0-a7ab-2668ccd4081b None admin] RBAC: Authorizing `identity:get_role(role_id=7d7ee6a7e93f46e5bff0a079bfb7ea3e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:35.053282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293054bd-3941-4cc0-a7ab-2668ccd4081b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:35.054608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 422/852] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:34 2022] GET /identity/v3/roles/7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:35.060347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092350c-11a9-40b3-b8c7-ca027ab3111e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:35.134360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:35.155777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092350c-11a9-40b3-b8c7-ca027ab3111e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:35.188679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1b56-c635-47ba-8176-951646ee3f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:35.189234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1b56-c635-47ba-8176-951646ee3f12 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.189528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1b56-c635-47ba-8176-951646ee3f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.189830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1b56-c635-47ba-8176-951646ee3f12 None admin] PATH_INFO: `/v3/users/f3555e4a48604d9a82c17adf35871fd1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.190928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f1b56-c635-47ba-8176-951646ee3f12 None admin] RBAC: Authorizing `identity:get_user(user_id=f3555e4a48604d9a82c17adf35871fd1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:35.192339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f1b56-c635-47ba-8176-951646ee3f12 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:35.193963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 431/853] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:35 2022] GET /identity/v3/users/f3555e4a48604d9a82c17adf35871fd1 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:35.199655 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293054bd-3941-4cc0-a7ab-2668ccd4081b None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:35.294230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293054bd-3941-4cc0-a7ab-2668ccd4081b None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:35.325736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea6e34-a59a-4e7e-8aa0-86a4975b1f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:35.326315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea6e34-a59a-4e7e-8aa0-86a4975b1f1f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.326588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea6e34-a59a-4e7e-8aa0-86a4975b1f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.326854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea6e34-a59a-4e7e-8aa0-86a4975b1f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.355558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:35.390969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea6e34-a59a-4e7e-8aa0-86a4975b1f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:35.392370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea6e34-a59a-4e7e-8aa0-86a4975b1f1f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:35.484339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 423/854] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:48:35.490700 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1b56-c635-47ba-8176-951646ee3f12 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:35.587503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1b56-c635-47ba-8176-951646ee3f12 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:35.619986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73a895-35ae-4343-a166-141b5922cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:35.620597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73a895-35ae-4343-a166-141b5922cd5a None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.620872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73a895-35ae-4343-a166-141b5922cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.621152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73a895-35ae-4343-a166-141b5922cd5a None admin] PATH_INFO: `/v3/projects/858a79c07de9485495f713af97704855` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.622282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73a895-35ae-4343-a166-141b5922cd5a None admin] RBAC: Authorizing `identity:get_project(project_id=858a79c07de9485495f713af97704855)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:35.623700 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73a895-35ae-4343-a166-141b5922cd5a None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:35.625288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 432/855] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:48:35 2022] GET /identity/v3/projects/858a79c07de9485495f713af97704855 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:35.631915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea6e34-a59a-4e7e-8aa0-86a4975b1f1f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:35.690517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:35.726184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea6e34-a59a-4e7e-8aa0-86a4975b1f1f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:35.758942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d653e-aab8-455a-9c94-c6ac035d55d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:35.759466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d653e-aab8-455a-9c94-c6ac035d55d0 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.759740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d653e-aab8-455a-9c94-c6ac035d55d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.760003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d653e-aab8-455a-9c94-c6ac035d55d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.760709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d653e-aab8-455a-9c94-c6ac035d55d0 None admin] RBAC: Adding query filter params (role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e, scope.project.id=858a79c07de9485495f713af97704855, user.id=f3555e4a48604d9a82c17adf35871fd1) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:35.761009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d653e-aab8-455a-9c94-c6ac035d55d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:35.762433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d653e-aab8-455a-9c94-c6ac035d55d0 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:35.768492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 424/856] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:35 2022] GET /identity/v3/role_assignments?user.id=f3555e4a48604d9a82c17adf35871fd1&scope.project.id=858a79c07de9485495f713af97704855&role.id=7d7ee6a7e93f46e5bff0a079bfb7ea3e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:37.894020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91484-336b-4015-a2ac-7b5a974ac66e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.894545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91484-336b-4015-a2ac-7b5a974ac66e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.894545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91484-336b-4015-a2ac-7b5a974ac66e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.895869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 433/857] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:37.901341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109740f-afc6-49fb-b07b-e4bce45ee67d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.901737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109740f-afc6-49fb-b07b-e4bce45ee67d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.901912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109740f-afc6-49fb-b07b-e4bce45ee67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.920641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5109740f-afc6-49fb-b07b-e4bce45ee67d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:37.921846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5109740f-afc6-49fb-b07b-e4bce45ee67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:37.987583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 425/858] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:38.256664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c91484-336b-4015-a2ac-7b5a974ac66e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.272821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:38.355162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c91484-336b-4015-a2ac-7b5a974ac66e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.387833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f092e-755b-449e-a99b-0e87d8a9ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.388443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f092e-755b-449e-a99b-0e87d8a9ec01 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.388718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f092e-755b-449e-a99b-0e87d8a9ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.388986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f092e-755b-449e-a99b-0e87d8a9ec01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.390103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f092e-755b-449e-a99b-0e87d8a9ec01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.391517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f092e-755b-449e-a99b-0e87d8a9ec01 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.393650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 434/859] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:38.399394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109740f-afc6-49fb-b07b-e4bce45ee67d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.453362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:38.493681 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109740f-afc6-49fb-b07b-e4bce45ee67d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.525988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ba095-21d3-4f91-b9e7-aaf0a975fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.526520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba095-21d3-4f91-b9e7-aaf0a975fa1f None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.526794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba095-21d3-4f91-b9e7-aaf0a975fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.527061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba095-21d3-4f91-b9e7-aaf0a975fa1f None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.527697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ba095-21d3-4f91-b9e7-aaf0a975fa1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.529098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ba095-21d3-4f91-b9e7-aaf0a975fa1f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.554793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 426/860] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:38 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:40.718260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc7162-81c7-4e92-9c61-2d0906f6bae5 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:40.718860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc7162-81c7-4e92-9c61-2d0906f6bae5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:40.718860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc7162-81c7-4e92-9c61-2d0906f6bae5 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:40.720136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 435/861] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:40.725412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8f17-af21-4289-b966-2e8573105ca9 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:40.725850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8f17-af21-4289-b966-2e8573105ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:40.725982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8f17-af21-4289-b966-2e8573105ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:40.744364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-294c8f17-af21-4289-b966-2e8573105ca9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:40.745555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-294c8f17-af21-4289-b966-2e8573105ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:40.808398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 427/862] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:41.073628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc7162-81c7-4e92-9c61-2d0906f6bae5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:41.152243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:41.170981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc7162-81c7-4e92-9c61-2d0906f6bae5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:41.203296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc14064-7564-46a5-97b7-3b197a819dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:41.203913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc14064-7564-46a5-97b7-3b197a819dcd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:41.204189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc14064-7564-46a5-97b7-3b197a819dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:41.204458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc14064-7564-46a5-97b7-3b197a819dcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:41.206128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc14064-7564-46a5-97b7-3b197a819dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:41.207547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc14064-7564-46a5-97b7-3b197a819dcd None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:41.209073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 436/863] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:41.214744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c8f17-af21-4289-b966-2e8573105ca9 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:41.254472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:41.309999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c8f17-af21-4289-b966-2e8573105ca9 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:41.342706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8212959-502b-4611-b849-01072ac323be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:41.343292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8212959-502b-4611-b849-01072ac323be None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:41.343569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8212959-502b-4611-b849-01072ac323be None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:41.343839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8212959-502b-4611-b849-01072ac323be None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:41.344480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8212959-502b-4611-b849-01072ac323be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:41.345942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8212959-502b-4611-b849-01072ac323be None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:41.366269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 428/864] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:41 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:43.514685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412e92-b5bb-433f-92e8-26ab63d988fd None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.515206 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412e92-b5bb-433f-92e8-26ab63d988fd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.515206 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412e92-b5bb-433f-92e8-26ab63d988fd None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.516546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 437/865] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:43.521753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8a3cd-517f-43fb-a24a-7ac118c39d7d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.522158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8a3cd-517f-43fb-a24a-7ac118c39d7d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.522297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8a3cd-517f-43fb-a24a-7ac118c39d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.540499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8ea8a3cd-517f-43fb-a24a-7ac118c39d7d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:43.541716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8ea8a3cd-517f-43fb-a24a-7ac118c39d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:43.605351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 429/866] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:43.869872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412e92-b5bb-433f-92e8-26ab63d988fd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:43.967461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412e92-b5bb-433f-92e8-26ab63d988fd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.000713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b1a13-4aac-43e9-aa32-33f7e9c5e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.001332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b1a13-4aac-43e9-aa32-33f7e9c5e807 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.001643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b1a13-4aac-43e9-aa32-33f7e9c5e807 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.002452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b1a13-4aac-43e9-aa32-33f7e9c5e807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.012155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b1a13-4aac-43e9-aa32-33f7e9c5e807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-792b1a13-4aac-43e9-aa32-33f7e9c5e807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:44.016911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:44.018058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:44.019084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 438/867] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:44.024035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8a3cd-517f-43fb-a24a-7ac118c39d7d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.050044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:44.120103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8a3cd-517f-43fb-a24a-7ac118c39d7d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.151548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.152134 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.152405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.152675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.153324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:44.153651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.154989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.163067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 430/868] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:44.168646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b1a13-4aac-43e9-aa32-33f7e9c5e807 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.181619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:44.265467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b1a13-4aac-43e9-aa32-33f7e9c5e807 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.298018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57163b9a-8633-4aab-8cc8-de3b9a946036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.298626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57163b9a-8633-4aab-8cc8-de3b9a946036 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.298968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57163b9a-8633-4aab-8cc8-de3b9a946036 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.299237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57163b9a-8633-4aab-8cc8-de3b9a946036 None admin] PATH_INFO: `/v3/users/b890c13a60bd459498db073f53451630` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.312295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57163b9a-8633-4aab-8cc8-de3b9a946036 None admin] RBAC: Authorizing `identity:get_user(user_id=b890c13a60bd459498db073f53451630)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.313760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57163b9a-8633-4aab-8cc8-de3b9a946036 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.315834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 439/869] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:44 2022] GET /identity/v3/users/b890c13a60bd459498db073f53451630 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:44.321502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.405444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:44.417223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877d2a7-8978-4ff2-81e7-64fdb2e329a7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.448687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4beda-8d50-489c-83f5-aaff9ead1176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.449292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4beda-8d50-489c-83f5-aaff9ead1176 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.449589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4beda-8d50-489c-83f5-aaff9ead1176 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.449857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4beda-8d50-489c-83f5-aaff9ead1176 None admin] PATH_INFO: `/v3/projects/a9e0f62f18f245878177f5fff5b33ebd` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.450950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4beda-8d50-489c-83f5-aaff9ead1176 None admin] RBAC: Authorizing `identity:get_project(project_id=a9e0f62f18f245878177f5fff5b33ebd)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.452355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4beda-8d50-489c-83f5-aaff9ead1176 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.453953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 431/870] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:48:44 2022] GET /identity/v3/projects/a9e0f62f18f245878177f5fff5b33ebd => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:44.459732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57163b9a-8633-4aab-8cc8-de3b9a946036 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.523592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:44.555543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57163b9a-8633-4aab-8cc8-de3b9a946036 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.587998 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9041621-b5b1-405f-a6f7-6e95f0313b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.588654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9041621-b5b1-405f-a6f7-6e95f0313b21 None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.588926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9041621-b5b1-405f-a6f7-6e95f0313b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.589188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9041621-b5b1-405f-a6f7-6e95f0313b21 None admin] PATH_INFO: `/v3/projects/a9e0f62f18f245878177f5fff5b33ebd/users/b890c13a60bd459498db073f53451630/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.591056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9041621-b5b1-405f-a6f7-6e95f0313b21 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9e0f62f18f245878177f5fff5b33ebd, user_id=b890c13a60bd459498db073f53451630, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.592457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9041621-b5b1-405f-a6f7-6e95f0313b21 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.604393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 440/871] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:44 2022] PUT /identity/v3/projects/a9e0f62f18f245878177f5fff5b33ebd/users/b890c13a60bd459498db073f53451630/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:46.697112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353c7bc-8913-4762-b472-0dcf748cc3d5 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:46.697727 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353c7bc-8913-4762-b472-0dcf748cc3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:46.698095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353c7bc-8913-4762-b472-0dcf748cc3d5 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:46.699433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 432/872] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:46.704597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e609c-25a2-4203-871f-651574d079d2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:46.705604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e609c-25a2-4203-871f-651574d079d2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:46.705759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e609c-25a2-4203-871f-651574d079d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:46.723482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c53e609c-25a2-4203-871f-651574d079d2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:46.724675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c53e609c-25a2-4203-871f-651574d079d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:46.789539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 441/873] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:47.059204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353c7bc-8913-4762-b472-0dcf748cc3d5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:47.163659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353c7bc-8913-4762-b472-0dcf748cc3d5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:47.197036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2cad-bd82-47c0-bff1-12fccd089f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:47.197692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2cad-bd82-47c0-bff1-12fccd089f18 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:47.198066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2cad-bd82-47c0-bff1-12fccd089f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:47.198341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2cad-bd82-47c0-bff1-12fccd089f18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:47.208057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc2cad-bd82-47c0-bff1-12fccd089f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-78fc2cad-bd82-47c0-bff1-12fccd089f18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:47.212751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:47.213963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:48:47.214926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 433/874] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:47.220108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e609c-25a2-4203-871f-651574d079d2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:47.276579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:47.318049 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e609c-25a2-4203-871f-651574d079d2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:47.350597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:47.351192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:47.351469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:47.351738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:47.352388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:47.352691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:47.354089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:47.362753 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 442/875] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:47.368532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2cad-bd82-47c0-bff1-12fccd089f18 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:47.386322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:47.464238 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc2cad-bd82-47c0-bff1-12fccd089f18 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:47.496739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dbb9a-ed7c-49f9-a7ae-f6c90e5d9606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:47.497340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dbb9a-ed7c-49f9-a7ae-f6c90e5d9606 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:47.497639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dbb9a-ed7c-49f9-a7ae-f6c90e5d9606 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:47.497907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dbb9a-ed7c-49f9-a7ae-f6c90e5d9606 None admin] PATH_INFO: `/v3/users/b890c13a60bd459498db073f53451630` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:47.498990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dbb9a-ed7c-49f9-a7ae-f6c90e5d9606 None admin] RBAC: Authorizing `identity:get_user(user_id=b890c13a60bd459498db073f53451630)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:47.500399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dbb9a-ed7c-49f9-a7ae-f6c90e5d9606 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:47.502121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 434/876] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:47 2022] GET /identity/v3/users/b890c13a60bd459498db073f53451630 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:47.507767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:47.603908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02fd07-a5d9-454b-b1f3-282ddf7fd20b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:47.623332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:47.637192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bdfb0-6ad5-4107-ab67-9bc37adba530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:47.637820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bdfb0-6ad5-4107-ab67-9bc37adba530 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:47.638096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bdfb0-6ad5-4107-ab67-9bc37adba530 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:47.638372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bdfb0-6ad5-4107-ab67-9bc37adba530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:47.702562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bdfb0-6ad5-4107-ab67-9bc37adba530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:47.703995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bdfb0-6ad5-4107-ab67-9bc37adba530 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:47.798980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 443/877] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:48:47.804872 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dbb9a-ed7c-49f9-a7ae-f6c90e5d9606 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:47.885998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:47.901215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dbb9a-ed7c-49f9-a7ae-f6c90e5d9606 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:47.933943 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f009c-bfc0-4074-9873-f8f937759448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:47.934553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f009c-bfc0-4074-9873-f8f937759448 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:47.934826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f009c-bfc0-4074-9873-f8f937759448 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:47.935090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f009c-bfc0-4074-9873-f8f937759448 None admin] PATH_INFO: `/v3/projects/a9e0f62f18f245878177f5fff5b33ebd` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:47.936186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f009c-bfc0-4074-9873-f8f937759448 None admin] RBAC: Authorizing `identity:get_project(project_id=a9e0f62f18f245878177f5fff5b33ebd)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:47.937621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f009c-bfc0-4074-9873-f8f937759448 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:47.939276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 435/878] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:48:47 2022] GET /identity/v3/projects/a9e0f62f18f245878177f5fff5b33ebd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:47.945172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bdfb0-6ad5-4107-ab67-9bc37adba530 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:47.965571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:48.043815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bdfb0-6ad5-4107-ab67-9bc37adba530 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:48.076169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee993731-2a35-4c8e-905a-4fe5ecd231b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:48.076755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993731-2a35-4c8e-905a-4fe5ecd231b0 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:48.077031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993731-2a35-4c8e-905a-4fe5ecd231b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:48.077293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993731-2a35-4c8e-905a-4fe5ecd231b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:48.078032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee993731-2a35-4c8e-905a-4fe5ecd231b0 None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=a9e0f62f18f245878177f5fff5b33ebd, user.id=b890c13a60bd459498db073f53451630) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:48.078335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee993731-2a35-4c8e-905a-4fe5ecd231b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:48.079739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee993731-2a35-4c8e-905a-4fe5ecd231b0 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:48.085232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 444/879] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:47 2022] GET /identity/v3/role_assignments?user.id=b890c13a60bd459498db073f53451630&scope.project.id=a9e0f62f18f245878177f5fff5b33ebd&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:50.200621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50aba1-0980-4411-8229-0ebbb88c874e None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.201161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50aba1-0980-4411-8229-0ebbb88c874e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.201161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50aba1-0980-4411-8229-0ebbb88c874e None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.202549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 436/880] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:50.207793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ce9f-e472-46f2-83a3-205e58532f21 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.208220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ce9f-e472-46f2-83a3-205e58532f21 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.208315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ce9f-e472-46f2-83a3-205e58532f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.226501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3246ce9f-e472-46f2-83a3-205e58532f21 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:50.227669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3246ce9f-e472-46f2-83a3-205e58532f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:50.291403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 445/881] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:50.556289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50aba1-0980-4411-8229-0ebbb88c874e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.653365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50aba1-0980-4411-8229-0ebbb88c874e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.686045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab646-70f5-4e78-bef4-f560405c0d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.686624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab646-70f5-4e78-bef4-f560405c0d83 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.686892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab646-70f5-4e78-bef4-f560405c0d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.687156 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab646-70f5-4e78-bef4-f560405c0d83 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.687813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ab646-70f5-4e78-bef4-f560405c0d83 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.689737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ab646-70f5-4e78-bef4-f560405c0d83 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.704559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 437/882] 10.222.0.47 () {60 vars in 1138 bytes} [Fri Oct 14 12:48:50 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:52.848664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186cb13-cc7a-4083-8cce-e85ffd923e9d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:52.849253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186cb13-cc7a-4083-8cce-e85ffd923e9d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:52.849253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186cb13-cc7a-4083-8cce-e85ffd923e9d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:52.850601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 446/883] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:52.855861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405ed1-3b45-4eb7-aec0-988c631e4188 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:52.856253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405ed1-3b45-4eb7-aec0-988c631e4188 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:52.856427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405ed1-3b45-4eb7-aec0-988c631e4188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:52.874991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-04405ed1-3b45-4eb7-aec0-988c631e4188 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:52.876174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-04405ed1-3b45-4eb7-aec0-988c631e4188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:52.883950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:52.941731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 438/884] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:53.208385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186cb13-cc7a-4083-8cce-e85ffd923e9d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:53.224008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:53.305590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186cb13-cc7a-4083-8cce-e85ffd923e9d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:53.337722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e6357-3e3e-4547-b69a-1e34e00cb7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:53.338330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6357-3e3e-4547-b69a-1e34e00cb7ee None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.338602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6357-3e3e-4547-b69a-1e34e00cb7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.338869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6357-3e3e-4547-b69a-1e34e00cb7ee None admin] PATH_INFO: `/v3/domains/7819c4a52b75492eb836c1a6737d0289` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.349236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e6357-3e3e-4547-b69a-1e34e00cb7ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=7819c4a52b75492eb836c1a6737d0289)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:53.350698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e6357-3e3e-4547-b69a-1e34e00cb7ee None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:53.352233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 447/885] 10.222.0.47 () {56 vars in 1183 bytes} [Fri Oct 14 12:48:53 2022] GET /identity/v3/domains/7819c4a52b75492eb836c1a6737d0289 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:53.358108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04405ed1-3b45-4eb7-aec0-988c631e4188 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:53.452556 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04405ed1-3b45-4eb7-aec0-988c631e4188 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:53.485129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33dd12-54ec-49f5-962f-6223b8b37a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:53.485684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33dd12-54ec-49f5-962f-6223b8b37a88 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.486508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33dd12-54ec-49f5-962f-6223b8b37a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.486780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33dd12-54ec-49f5-962f-6223b8b37a88 None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.487428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33dd12-54ec-49f5-962f-6223b8b37a88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:53.488832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33dd12-54ec-49f5-962f-6223b8b37a88 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:53.502454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:53.514460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 439/886] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:53 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:55.652595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35491896-14df-44cc-8596-c43568f266ee None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:55.653166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35491896-14df-44cc-8596-c43568f266ee None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:55.653166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35491896-14df-44cc-8596-c43568f266ee None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:55.654492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 448/887] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:55.660153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367801be-5c56-4130-a65c-45408002de42 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:55.660531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367801be-5c56-4130-a65c-45408002de42 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:55.660690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367801be-5c56-4130-a65c-45408002de42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:55.678803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-367801be-5c56-4130-a65c-45408002de42 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:55.679966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-367801be-5c56-4130-a65c-45408002de42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:55.742919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 440/888] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:56.011309 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35491896-14df-44cc-8596-c43568f266ee None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:56.084449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:56.109948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35491896-14df-44cc-8596-c43568f266ee None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:56.143171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e2510-170b-4caa-81a4-42b188ed4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:56.143777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e2510-170b-4caa-81a4-42b188ed4eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.144054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e2510-170b-4caa-81a4-42b188ed4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.144317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e2510-170b-4caa-81a4-42b188ed4eb3 None admin] PATH_INFO: `/v3/domains/7819c4a52b75492eb836c1a6737d0289` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.145393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e2510-170b-4caa-81a4-42b188ed4eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7819c4a52b75492eb836c1a6737d0289)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:56.146838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e2510-170b-4caa-81a4-42b188ed4eb3 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:56.148361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 449/889] 10.222.0.47 () {56 vars in 1183 bytes} [Fri Oct 14 12:48:56 2022] GET /identity/v3/domains/7819c4a52b75492eb836c1a6737d0289 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:56.154121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367801be-5c56-4130-a65c-45408002de42 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:56.247497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367801be-5c56-4130-a65c-45408002de42 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:56.270348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:56.281220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8015a3b-cb6e-4654-a83f-afdcfd2aa41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:56.281852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015a3b-cb6e-4654-a83f-afdcfd2aa41d None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.282129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015a3b-cb6e-4654-a83f-afdcfd2aa41d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.282406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8015a3b-cb6e-4654-a83f-afdcfd2aa41d None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.283070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8015a3b-cb6e-4654-a83f-afdcfd2aa41d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:56.284475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8015a3b-cb6e-4654-a83f-afdcfd2aa41d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:56.303557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 441/890] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:56 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:58.422566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a477-c0e5-4142-acfb-5eb946957384 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:58.423151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a477-c0e5-4142-acfb-5eb946957384 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:58.423151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1a477-c0e5-4142-acfb-5eb946957384 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:58.424487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 450/891] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:58.429644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249104-5c3f-47a7-b660-b82d65e5ffa0 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:58.430054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249104-5c3f-47a7-b660-b82d65e5ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:58.430192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84249104-5c3f-47a7-b660-b82d65e5ffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:58.448388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-84249104-5c3f-47a7-b660-b82d65e5ffa0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:58.449596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-84249104-5c3f-47a7-b660-b82d65e5ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:58.513834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 442/892] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:58.778454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1a477-c0e5-4142-acfb-5eb946957384 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:58.876459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1a477-c0e5-4142-acfb-5eb946957384 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:58.909080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f76877-aa40-4fac-b866-c1f82dbc94dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:58.909718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f76877-aa40-4fac-b866-c1f82dbc94dd None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:58.909998 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f76877-aa40-4fac-b866-c1f82dbc94dd None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:58.910269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f76877-aa40-4fac-b866-c1f82dbc94dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:58.920094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f76877-aa40-4fac-b866-c1f82dbc94dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-27f76877-aa40-4fac-b866-c1f82dbc94dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:58.925418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:58.926614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:48:58.927747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 451/893] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:58.932388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84249104-5c3f-47a7-b660-b82d65e5ffa0 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:59.028299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84249104-5c3f-47a7-b660-b82d65e5ffa0 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:59.039930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:59.063082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:59.064228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.064508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.064777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.065440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:59.065774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:59.067115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:59.074983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 443/894] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:59.081390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f76877-aa40-4fac-b866-c1f82dbc94dd None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:59.084868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:59.180123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f76877-aa40-4fac-b866-c1f82dbc94dd None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:59.213424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfc09e-f48f-4f83-8216-98b9a0e70569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:59.214078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfc09e-f48f-4f83-8216-98b9a0e70569 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.214351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfc09e-f48f-4f83-8216-98b9a0e70569 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.214620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfc09e-f48f-4f83-8216-98b9a0e70569 None admin] PATH_INFO: `/v3/users/a3c0a9e2493a458bb3f3d503c502c936` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.227886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbfc09e-f48f-4f83-8216-98b9a0e70569 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c0a9e2493a458bb3f3d503c502c936)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:59.229336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbfc09e-f48f-4f83-8216-98b9a0e70569 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:59.230985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 452/895] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:48:59 2022] GET /identity/v3/users/a3c0a9e2493a458bb3f3d503c502c936 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:59.237277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:59.332754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268099-e357-4792-b90e-91024be4ed3e None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:59.364165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400510-80c1-4780-8bf4-afd3670491eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:59.364778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400510-80c1-4780-8bf4-afd3670491eb None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.365051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400510-80c1-4780-8bf4-afd3670491eb None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.365324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400510-80c1-4780-8bf4-afd3670491eb None admin] PATH_INFO: `/v3/projects/32e980064b034deeb314872c8d14326c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.366446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400510-80c1-4780-8bf4-afd3670491eb None admin] RBAC: Authorizing `identity:get_project(project_id=32e980064b034deeb314872c8d14326c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:59.367852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400510-80c1-4780-8bf4-afd3670491eb None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:59.369436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 444/896] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:48:59 2022] GET /identity/v3/projects/32e980064b034deeb314872c8d14326c => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:59.375154 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfc09e-f48f-4f83-8216-98b9a0e70569 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:59.431681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:59.471236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfc09e-f48f-4f83-8216-98b9a0e70569 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:59.504547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c658c-0fd8-43af-b6a2-1df8e24c046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:59.505186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c658c-0fd8-43af-b6a2-1df8e24c046f None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.505457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c658c-0fd8-43af-b6a2-1df8e24c046f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.505752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c658c-0fd8-43af-b6a2-1df8e24c046f None admin] PATH_INFO: `/v3/projects/32e980064b034deeb314872c8d14326c/users/a3c0a9e2493a458bb3f3d503c502c936/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.507608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c658c-0fd8-43af-b6a2-1df8e24c046f None admin] RBAC: Authorizing `identity:create_grant(project_id=32e980064b034deeb314872c8d14326c, user_id=a3c0a9e2493a458bb3f3d503c502c936, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:59.509023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c658c-0fd8-43af-b6a2-1df8e24c046f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:59.520824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 453/897] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:59 2022] PUT /identity/v3/projects/32e980064b034deeb314872c8d14326c/users/a3c0a9e2493a458bb3f3d503c502c936/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:49:01.629672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec566bc-793a-4af1-8493-182b954faf38 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.630227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec566bc-793a-4af1-8493-182b954faf38 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.630227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec566bc-793a-4af1-8493-182b954faf38 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.631557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 445/898] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:01.636764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8226e-e094-40b2-9881-21f306fc4438 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.637197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8226e-e094-40b2-9881-21f306fc4438 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.637297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8226e-e094-40b2-9881-21f306fc4438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.654875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e8f8226e-e094-40b2-9881-21f306fc4438 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:01.656041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e8f8226e-e094-40b2-9881-21f306fc4438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:01.721359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 454/899] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:01.996025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec566bc-793a-4af1-8493-182b954faf38 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:02.038282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:02.094353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec566bc-793a-4af1-8493-182b954faf38 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:02.126765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d057-21ec-4076-bd6f-ab67e4d37100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:02.127369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d057-21ec-4076-bd6f-ab67e4d37100 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:02.127641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d057-21ec-4076-bd6f-ab67e4d37100 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:02.127906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d057-21ec-4076-bd6f-ab67e4d37100 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:02.137511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293d057-21ec-4076-bd6f-ab67e4d37100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-9293d057-21ec-4076-bd6f-ab67e4d37100 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:02.142776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:02.143858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:49:02.145046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 446/900] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:02.149784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8226e-e094-40b2-9881-21f306fc4438 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:02.196772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:02.245453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8226e-e094-40b2-9881-21f306fc4438 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:02.278520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:02.279115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:02.279391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:02.279661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:02.280312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:02.280611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:02.281997 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:02.289818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 455/901] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:02.295680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d057-21ec-4076-bd6f-ab67e4d37100 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:02.388750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:02.392398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d057-21ec-4076-bd6f-ab67e4d37100 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:02.424999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cf5e6-ca1a-4dae-8e35-cc7f7277c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:02.425637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf5e6-ca1a-4dae-8e35-cc7f7277c2af None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:02.425916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf5e6-ca1a-4dae-8e35-cc7f7277c2af None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:02.426186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf5e6-ca1a-4dae-8e35-cc7f7277c2af None admin] PATH_INFO: `/v3/users/a3c0a9e2493a458bb3f3d503c502c936` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:02.427307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cf5e6-ca1a-4dae-8e35-cc7f7277c2af None admin] RBAC: Authorizing `identity:get_user(user_id=a3c0a9e2493a458bb3f3d503c502c936)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:02.428728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cf5e6-ca1a-4dae-8e35-cc7f7277c2af None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:02.430293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 447/902] 10.222.0.47 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:02 2022] GET /identity/v3/users/a3c0a9e2493a458bb3f3d503c502c936 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:02.435874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:02.532208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca25a1-1a8d-4146-abb7-c1fc2b457797 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:02.544156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:02.565356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccbc45-50af-4d82-ae85-ef1f13526328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:02.565979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccbc45-50af-4d82-ae85-ef1f13526328 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:02.566256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccbc45-50af-4d82-ae85-ef1f13526328 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:02.566526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccbc45-50af-4d82-ae85-ef1f13526328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:02.629394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccbc45-50af-4d82-ae85-ef1f13526328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:02.630869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccbc45-50af-4d82-ae85-ef1f13526328 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:02.725552 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 456/903] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:49:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:49:02.731482 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cf5e6-ca1a-4dae-8e35-cc7f7277c2af None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:02.827670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cf5e6-ca1a-4dae-8e35-cc7f7277c2af None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:02.859498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede107aa-3de1-43f8-83da-ef0ab1f56bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:02.860108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede107aa-3de1-43f8-83da-ef0ab1f56bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:02.860380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede107aa-3de1-43f8-83da-ef0ab1f56bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:02.861169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede107aa-3de1-43f8-83da-ef0ab1f56bc8 None admin] PATH_INFO: `/v3/projects/32e980064b034deeb314872c8d14326c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:02.862303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede107aa-3de1-43f8-83da-ef0ab1f56bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=32e980064b034deeb314872c8d14326c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:02.863710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede107aa-3de1-43f8-83da-ef0ab1f56bc8 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:02.865287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 448/904] 10.222.0.47 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:02 2022] GET /identity/v3/projects/32e980064b034deeb314872c8d14326c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:02.871267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccbc45-50af-4d82-ae85-ef1f13526328 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:02.884845 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:02.966869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccbc45-50af-4d82-ae85-ef1f13526328 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:03.001403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac123b-9b3d-4c21-aa8b-8e66480e11e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:03.002044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac123b-9b3d-4c21-aa8b-8e66480e11e4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:03.002306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac123b-9b3d-4c21-aa8b-8e66480e11e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:03.002573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac123b-9b3d-4c21-aa8b-8e66480e11e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:03.003290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac123b-9b3d-4c21-aa8b-8e66480e11e4 None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=32e980064b034deeb314872c8d14326c, user.id=a3c0a9e2493a458bb3f3d503c502c936) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:03.003596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac123b-9b3d-4c21-aa8b-8e66480e11e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:03.005017 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac123b-9b3d-4c21-aa8b-8e66480e11e4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:03.010644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 457/905] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:49:02 2022] GET /identity/v3/role_assignments?user.id=a3c0a9e2493a458bb3f3d503c502c936&scope.project.id=32e980064b034deeb314872c8d14326c&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:12.855274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=82 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:13.008105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=62 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:57.909334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d530d2-e273-43d7-b317-5e1d96cf17ad None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:57.909950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d530d2-e273-43d7-b317-5e1d96cf17ad None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:57.910038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d530d2-e273-43d7-b317-5e1d96cf17ad None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:57.911420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 449/906] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:57.917237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1e03-ace6-4ac2-941e-53c60d37d7f4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:57.917749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1e03-ace6-4ac2-941e-53c60d37d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:57.918074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f1e03-ace6-4ac2-941e-53c60d37d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:57.938599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-110f1e03-ace6-4ac2-941e-53c60d37d7f4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:57.939894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-110f1e03-ace6-4ac2-941e-53c60d37d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:58.035359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 458/907] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:58.328533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d530d2-e273-43d7-b317-5e1d96cf17ad None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:58.474396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d530d2-e273-43d7-b317-5e1d96cf17ad None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:58.521860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:58.522814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:58.523268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:58.523701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:58.539734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:58.541186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:49:58.567260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:58.568544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:49:58.569557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:49:58.569557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:58.569557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:49:58.569557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 450/908] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:58.575236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f1e03-ace6-4ac2-941e-53c60d37d7f4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:58.709590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f1e03-ace6-4ac2-941e-53c60d37d7f4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:58.744755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:58.752787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda0e4-ce14-4f09-b8fa-d6b46911a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:58.753448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda0e4-ce14-4f09-b8fa-d6b46911a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:58.753769 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda0e4-ce14-4f09-b8fa-d6b46911a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:58.757315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda0e4-ce14-4f09-b8fa-d6b46911a5b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:58.757315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda0e4-ce14-4f09-b8fa-d6b46911a5b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:58.757315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda0e4-ce14-4f09-b8fa-d6b46911a5b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:58.757315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda0e4-ce14-4f09-b8fa-d6b46911a5b6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:58.773636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 459/909] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:58.780144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:58.846348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:58.904331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45561-96ba-4ccf-ba75-110d41887182 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:58.952868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92141536-575a-4938-b361-f0f8c1ee15d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:58.954600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141536-575a-4938-b361-f0f8c1ee15d0 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:58.954600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141536-575a-4938-b361-f0f8c1ee15d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:58.954600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141536-575a-4938-b361-f0f8c1ee15d0 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:58.954837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92141536-575a-4938-b361-f0f8c1ee15d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:58.956256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92141536-575a-4938-b361-f0f8c1ee15d0 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:58.984889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 451/910] 10.222.0.47 () {60 vars in 1132 bytes} [Fri Oct 14 12:49:58 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:50:01.514559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057fe92-7338-4215-834c-f04067f67dd3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:01.515123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057fe92-7338-4215-834c-f04067f67dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:01.515267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057fe92-7338-4215-834c-f04067f67dd3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:01.516857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 460/911] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:01.522360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868b6a-3937-4f5a-b1f6-d36cae3081ce None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:01.522816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868b6a-3937-4f5a-b1f6-d36cae3081ce None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:01.522916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13868b6a-3937-4f5a-b1f6-d36cae3081ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:01.542487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-13868b6a-3937-4f5a-b1f6-d36cae3081ce None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:01.543702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-13868b6a-3937-4f5a-b1f6-d36cae3081ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:01.630602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 452/912] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:01.922356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057fe92-7338-4215-834c-f04067f67dd3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:02.040172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057fe92-7338-4215-834c-f04067f67dd3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:02.082965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347ce1-85c7-44d7-ad37-2c7343c508da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:02.083805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347ce1-85c7-44d7-ad37-2c7343c508da None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:02.084149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347ce1-85c7-44d7-ad37-2c7343c508da None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:02.084424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347ce1-85c7-44d7-ad37-2c7343c508da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:02.097215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa347ce1-85c7-44d7-ad37-2c7343c508da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-aa347ce1-85c7-44d7-ad37-2c7343c508da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:50:02.102207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:02.103217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:02.104097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 461/913] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:02.109934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13868b6a-3937-4f5a-b1f6-d36cae3081ce None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:02.155654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:02.224357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13868b6a-3937-4f5a-b1f6-d36cae3081ce None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:02.261289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:02.262195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:02.262582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:02.262947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:02.263822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:02.264139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:02.266364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:02.280661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 453/914] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:50:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:50:02.281950 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347ce1-85c7-44d7-ad37-2c7343c508da None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:02.341003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:02.399611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347ce1-85c7-44d7-ad37-2c7343c508da None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:02.441792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:02.442453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:02.442825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:02.443102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:02.456016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:02.457551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:02.474586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:02.475644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:02.476604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:02.476604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:02.476604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:02.476604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 462/915] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:02.481364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:02.592307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:02.595912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c18031-0e06-4692-9d7d-a52de97bd5b3 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:02.632091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:02.632887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:02.633269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:02.633673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:02.634433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:02.634858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:02.636466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:02.653415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 454/916] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:02.660723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:02.781441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae11e9-e0b5-4a95-8b7d-7532e04c6728 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:02.783056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:02.818585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:02.819420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:02.819836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:02.820217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:02.829250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:02.830951 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:50:02.843846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:02.845009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:02.846213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:02.848086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 463/917] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:02.853966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:02.964769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc408c3-5a27-4011-86c0-fb1b928d79ed None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:03.001317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:03.001950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:03.002224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:03.002503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:03.003334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:03.003659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:03.005066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:03.028208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 455/918] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Oct 14 12:50:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:03.029307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:03.149120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750437a0-e804-4f1d-a924-abc9f796f554 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:03.186996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:03.187623 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:03.187896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:03.188159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:03.199678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:03.201122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:03.215233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:03.216211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:03.217090 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:03.217090 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:03.217090 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:03.217090 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 464/919] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:03.222250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:03.242732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:03.331867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942e208-1b12-4612-b93a-c30eac53d2a9 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:03.371540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:03.372330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:03.372607 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:03.372876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:03.373614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:03.374416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:03.375767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:03.388385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 456/920] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:03.394469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:03.418875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:03.529852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b23df-1cdb-4170-8024-f4c865eaa291 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:03.579610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:03.580262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:03.580534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:03.580846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:03.588130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:03.589629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:50:03.601125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:03.602456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:03.603593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 465/921] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:03.608954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:03.701804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:03.726261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941adc44-1bd6-4d3f-a289-f72ec8208850 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:03.762531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5c87f-6cc6-41db-863c-056666c20749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:03.763136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c87f-6cc6-41db-863c-056666c20749 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:03.763489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c87f-6cc6-41db-863c-056666c20749 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:03.763763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c87f-6cc6-41db-863c-056666c20749 None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:03.765098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5c87f-6cc6-41db-863c-056666c20749 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:03.765421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5c87f-6cc6-41db-863c-056666c20749 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:03.766855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5c87f-6cc6-41db-863c-056666c20749 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:03.779642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 457/922] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:50:03.786297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:03.867375 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:03.896786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59fed9-26ec-45e7-812d-ee995c25a18f None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:03.931314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772aa84-6415-4dd2-8c16-a2fca444c4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:03.931972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772aa84-6415-4dd2-8c16-a2fca444c4be None admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:03.932246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772aa84-6415-4dd2-8c16-a2fca444c4be None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:03.932516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772aa84-6415-4dd2-8c16-a2fca444c4be None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/b4a7dff4f94f4b28ab8e5ae9b7d9aebd/roles/df5e47546621472692145fb33dc3d1a2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:03.948828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772aa84-6415-4dd2-8c16-a2fca444c4be None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=b4a7dff4f94f4b28ab8e5ae9b7d9aebd, role_id=df5e47546621472692145fb33dc3d1a2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:03.950325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772aa84-6415-4dd2-8c16-a2fca444c4be None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:03.962308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 466/923] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:50:03 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/b4a7dff4f94f4b28ab8e5ae9b7d9aebd/roles/df5e47546621472692145fb33dc3d1a2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:50:06.239309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a9116-3d16-4651-b101-0c71502c579e None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:06.239914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a9116-3d16-4651-b101-0c71502c579e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:06.239914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a9116-3d16-4651-b101-0c71502c579e None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:06.241095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 458/924] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:06.246351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c51cb-2cab-4954-9f24-6e539bb9cc18 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:06.246772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c51cb-2cab-4954-9f24-6e539bb9cc18 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:06.246894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c51cb-2cab-4954-9f24-6e539bb9cc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:06.265709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9e4c51cb-2cab-4954-9f24-6e539bb9cc18 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:06.266947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9e4c51cb-2cab-4954-9f24-6e539bb9cc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:06.338244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 467/925] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:06.620586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a9116-3d16-4651-b101-0c71502c579e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:06.730250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a9116-3d16-4651-b101-0c71502c579e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:06.768178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbd784-961f-44f6-9156-48ce8ec7953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:06.768798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbd784-961f-44f6-9156-48ce8ec7953e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:06.769091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbd784-961f-44f6-9156-48ce8ec7953e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:06.769350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbd784-961f-44f6-9156-48ce8ec7953e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:06.777598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:06.782239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbd784-961f-44f6-9156-48ce8ec7953e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-a0bbd784-961f-44f6-9156-48ce8ec7953e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:50:06.787282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:06.788848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:06.789884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 459/926] 10.222.0.47 () {56 vars in 1102 bytes} [Fri Oct 14 12:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:06.794858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c51cb-2cab-4954-9f24-6e539bb9cc18 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:06.856603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:06.903612 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c51cb-2cab-4954-9f24-6e539bb9cc18 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:06.938910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:06.939512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:06.939790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:06.940059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:06.940709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:06.941008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:06.942391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:06.950285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 468/927] 10.222.0.47 () {56 vars in 1103 bytes} [Fri Oct 14 12:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:06.956975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbd784-961f-44f6-9156-48ce8ec7953e None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:07.058778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbd784-961f-44f6-9156-48ce8ec7953e None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:07.097428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:07.098107 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:07.098423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:07.098671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:07.108750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:07.110218 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:07.124532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:07.125643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:07.126677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:07.126677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:07.126677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:07.126677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 460/928] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:07.131854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:07.235393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17646c31-3070-4249-9056-a727735e6b72 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:07.252699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:07.271647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:07.272420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:07.272741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:07.273082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:07.273780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:07.274119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:07.275489 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:07.289191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 469/929] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:07.296793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:07.352409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:07.408573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301d0d5-2d74-4eaf-a315-cba28114a99b None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:07.442878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:07.443495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:07.443769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:07.444035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:07.451418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:07.452894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:50:07.464957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:07.466309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:07.467813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 461/930] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:07.472470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:07.579157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29cf1-caac-4abf-bf66-42b2cf932eba None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:07.616990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:07.617699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:07.617992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:07.618248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:07.618979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:07.619289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:07.621027 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:07.643531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 470/931] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Oct 14 12:50:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:07.650011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:07.762623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0879e90-bc4d-4e4a-baf8-be14e7ff41c1 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:07.773316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:07.802403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011de48-fe5e-4ef2-87e3-bdf089d155e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:07.803033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011de48-fe5e-4ef2-87e3-bdf089d155e2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:07.803312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011de48-fe5e-4ef2-87e3-bdf089d155e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:07.803582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011de48-fe5e-4ef2-87e3-bdf089d155e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:07.878675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011de48-fe5e-4ef2-87e3-bdf089d155e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:07.880122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011de48-fe5e-4ef2-87e3-bdf089d155e2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:07.997663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 462/932] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:50:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:50:07.999198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:08.036606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:08.109828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b4f67-7b20-4f39-8573-4159e181c196 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:08.144480 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:08.145038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:08.145312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:08.145612 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:08.156640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:08.158134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:08.173376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:08.174598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:08.175705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:08.175705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:08.175705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:08.175705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 471/933] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:08.180388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011de48-fe5e-4ef2-87e3-bdf089d155e2 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:08.193025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:08.286593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011de48-fe5e-4ef2-87e3-bdf089d155e2 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:08.322131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:08.322833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:08.323168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:08.323532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:08.324302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:08.324720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:08.326262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:08.339208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 463/934] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:08.345449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:08.436693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:08.452851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10944012-db02-4a70-9f45-46e0ddd49c04 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:08.489762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:08.490392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:08.490666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:08.490939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:08.497475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:08.499445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:50:08.511103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:08.512243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:08.513294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 472/935] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:50:08.518640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:08.589008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:08.621858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7f183-31fa-4103-b14a-08141534344f None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:08.657236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e89d-4e4d-467b-b527-c3bf7f13ba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:08.657814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e89d-4e4d-467b-b527-c3bf7f13ba3e None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:08.658206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e89d-4e4d-467b-b527-c3bf7f13ba3e None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:08.658385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e89d-4e4d-467b-b527-c3bf7f13ba3e None admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:08.659057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e89d-4e4d-467b-b527-c3bf7f13ba3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:08.659370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e89d-4e4d-467b-b527-c3bf7f13ba3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:08.660785 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e89d-4e4d-467b-b527-c3bf7f13ba3e None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:08.673892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 464/936] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:08.679949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:08.790540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cad3f6-099b-44f7-953e-4971d601881b None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:08.826661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011eb79-33f3-49bb-8ec8-b82336c57cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:08.827264 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011eb79-33f3-49bb-8ec8-b82336c57cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:08.827541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011eb79-33f3-49bb-8ec8-b82336c57cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:08.827809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011eb79-33f3-49bb-8ec8-b82336c57cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:08.828530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011eb79-33f3-49bb-8ec8-b82336c57cb1 None admin] RBAC: Adding query filter params (role.id=df5e47546621472692145fb33dc3d1a2, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=b4a7dff4f94f4b28ab8e5ae9b7d9aebd) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:08.828839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011eb79-33f3-49bb-8ec8-b82336c57cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:08.830290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011eb79-33f3-49bb-8ec8-b82336c57cb1 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:08.836293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 473/937] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:50:08 2022] GET /identity/v3/role_assignments?user.id=b4a7dff4f94f4b28ab8e5ae9b7d9aebd&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=df5e47546621472692145fb33dc3d1a2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:11.000030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951719e3-9aba-4992-8cc9-39edb02c3035 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:11.000529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951719e3-9aba-4992-8cc9-39edb02c3035 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:11.000628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951719e3-9aba-4992-8cc9-39edb02c3035 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:11.001927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 465/938] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:11.007458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a033-cb97-413b-aa13-3407b87d3623 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:11.007889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a033-cb97-413b-aa13-3407b87d3623 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:11.008071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a033-cb97-413b-aa13-3407b87d3623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:11.027143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7209a033-cb97-413b-aa13-3407b87d3623 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:11.028408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7209a033-cb97-413b-aa13-3407b87d3623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:11.031883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:11.102189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 474/939] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:11.369118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951719e3-9aba-4992-8cc9-39edb02c3035 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:11.479886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951719e3-9aba-4992-8cc9-39edb02c3035 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:11.510985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:11.517270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35795a-c5f8-48cb-b3dd-b99d3aed1f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:11.518195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35795a-c5f8-48cb-b3dd-b99d3aed1f1c None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:11.518707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35795a-c5f8-48cb-b3dd-b99d3aed1f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:11.518979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35795a-c5f8-48cb-b3dd-b99d3aed1f1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:11.529813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35795a-c5f8-48cb-b3dd-b99d3aed1f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-4a35795a-c5f8-48cb-b3dd-b99d3aed1f1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:50:11.535290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:11.536416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:11.537503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 466/940] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:11.543073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a033-cb97-413b-aa13-3407b87d3623 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:11.658630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a033-cb97-413b-aa13-3407b87d3623 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:11.697531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:11.698145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:11.698424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:11.698724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:11.699358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:11.699659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:11.701042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:11.710133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 475/941] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:50:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:11.716073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35795a-c5f8-48cb-b3dd-b99d3aed1f1c None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:11.827121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35795a-c5f8-48cb-b3dd-b99d3aed1f1c None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:11.861616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:11.862238 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:11.862544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:11.862780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:11.873032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:11.875166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:11.892531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:11.896804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:11.897951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:11.897951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:11.897951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:11.897951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 467/942] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:11.900094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:11.903651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:12.006991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4c249-15e9-4db2-a670-fe7ae36618bb None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:12.042790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:12.043483 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:12.043794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:12.044049 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:12.044739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:12.045047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:12.046516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:12.058516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 476/943] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:12.064686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:12.113934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:12.175148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8729cb-b28e-4841-bfe2-db8956ca8901 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:12.210651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:12.211268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:12.211542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:12.211809 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:12.219356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:12.220853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:50:12.235712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:12.236719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:12.238100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 468/944] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:12.242941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:12.314400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:12.357138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ab01d-7093-42fe-9351-bc605247f9b6 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:12.393499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:12.394112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:12.394385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:12.394651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:12.395369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:12.395670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:12.397083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:12.415271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 477/945] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Oct 14 12:50:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:12.420999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:12.532524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a578ae0-40e8-42c5-9522-ce5629993c04 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:12.534062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:12.570114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:12.570739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:12.571035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:12.571300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:12.582459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:12.584032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:12.602705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:12.608823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:12.610091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:12.610091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:12.610091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:12.610091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 469/946] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:12.610357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:12.724114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95630-2300-4654-9688-4cb8d064ad68 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:12.745932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:12.763306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:12.764092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:12.764400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:12.765224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:12.765943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:12.766250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:12.767751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:12.779742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 478/947] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:12.785648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:12.892897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59214805-d2b8-4625-a16e-e4c4346ccea8 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:12.931420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:12.932041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:12.932317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:12.932584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:12.940254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:12.941948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:50:12.954119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:12.955066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:12.955975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 470/948] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:50:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:12.962740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:13.076122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721954b-3cf2-499f-9305-7a8c1b61c338 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:13.113257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6031d28-f103-4b3d-b1a0-7442eaff39d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:13.113936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6031d28-f103-4b3d-b1a0-7442eaff39d5 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:13.114194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6031d28-f103-4b3d-b1a0-7442eaff39d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:13.114500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6031d28-f103-4b3d-b1a0-7442eaff39d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:13.115257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6031d28-f103-4b3d-b1a0-7442eaff39d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:13.115559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6031d28-f103-4b3d-b1a0-7442eaff39d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:13.116974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6031d28-f103-4b3d-b1a0-7442eaff39d5 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:13.129563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 479/949] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:13.136025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:13.154257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:13.245936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f6ab-19b0-4a60-8be0-d38329e86dad None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:13.283431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010025ae-9c1c-4f40-abe3-5c8cc7679769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:13.284185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010025ae-9c1c-4f40-abe3-5c8cc7679769 None admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:13.284462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010025ae-9c1c-4f40-abe3-5c8cc7679769 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:13.284775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010025ae-9c1c-4f40-abe3-5c8cc7679769 None admin] PATH_INFO: `/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/b4a7dff4f94f4b28ab8e5ae9b7d9aebd/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:13.286843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010025ae-9c1c-4f40-abe3-5c8cc7679769 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39ed153440b4dd9afb3945cfd55fed3, user_id=b4a7dff4f94f4b28ab8e5ae9b7d9aebd, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:13.288428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010025ae-9c1c-4f40-abe3-5c8cc7679769 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:13.301703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 471/950] 10.222.0.47 () {58 vars in 1439 bytes} [Fri Oct 14 12:50:13 2022] PUT /identity/v3/projects/a39ed153440b4dd9afb3945cfd55fed3/users/b4a7dff4f94f4b28ab8e5ae9b7d9aebd/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:50:15.657435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbbc83-9b24-46c8-af4e-501d2117f46c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:15.658045 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbbc83-9b24-46c8-af4e-501d2117f46c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:15.658045 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbbc83-9b24-46c8-af4e-501d2117f46c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:15.659677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 480/951] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:15.665968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e5803-9168-4bb9-a74e-77b32aa17f5a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:15.666495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e5803-9168-4bb9-a74e-77b32aa17f5a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:15.666495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e5803-9168-4bb9-a74e-77b32aa17f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:15.687697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f32e5803-9168-4bb9-a74e-77b32aa17f5a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:15.689466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f32e5803-9168-4bb9-a74e-77b32aa17f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:15.765167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 472/952] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:50:16.044666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbbc83-9b24-46c8-af4e-501d2117f46c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:16.093237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:16.156894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbbc83-9b24-46c8-af4e-501d2117f46c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:16.192605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bcca-83f2-4099-89b8-8dcdd11f1cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:16.193270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcca-83f2-4099-89b8-8dcdd11f1cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:16.193568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcca-83f2-4099-89b8-8dcdd11f1cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:16.193838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcca-83f2-4099-89b8-8dcdd11f1cf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:16.204425 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693bcca-83f2-4099-89b8-8dcdd11f1cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-0693bcca-83f2-4099-89b8-8dcdd11f1cf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:50:16.209239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:16.210381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:16.211420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 481/953] 10.222.0.47 () {56 vars in 1096 bytes} [Fri Oct 14 12:50:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:16.216618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e5803-9168-4bb9-a74e-77b32aa17f5a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:16.219915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:16.325006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e5803-9168-4bb9-a74e-77b32aa17f5a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:16.365016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:16.365740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:16.366022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:16.366322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:16.367092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:16.367389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:16.368745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:16.376750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 473/954] 10.222.0.47 () {56 vars in 1099 bytes} [Fri Oct 14 12:50:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:16.383025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bcca-83f2-4099-89b8-8dcdd11f1cf9 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:16.489354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:16.492622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bcca-83f2-4099-89b8-8dcdd11f1cf9 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:16.530707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:16.531340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:16.531618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:16.531888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:16.543195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:16.544842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:16.562019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:16.563123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:16.564388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:16.564388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:16.564388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:16.564388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 482/955] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:16.569008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:16.639570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:16.681880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a728d7a-cff4-4ec5-9abe-55eaffe0bce2 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:16.723041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:16.723688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:16.723965 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:16.724232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:16.724886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:16.725181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:16.726591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:16.740942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 474/956] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:16.746768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:16.856919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530d3b9-3f31-4960-8a03-6a99c3304cb4 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:16.892561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:16.893115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:16.893396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:16.893707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:16.902325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:16.903834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:50:16.917012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:16.918250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:16.919535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 483/957] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:16.924330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:17.030532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd854289-c1e8-483e-951d-fe9e520f34f7 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:17.057632 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:17.067497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:17.068110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:17.068389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:17.068660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:17.069519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:17.069836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:17.071276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:17.095102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 475/958] 10.222.0.47 () {56 vars in 1143 bytes} [Fri Oct 14 12:50:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:17.096421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:17.113026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:17.203608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bc5d-081a-4f95-9561-a30fb8daa714 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:17.236791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14954af4-1d7e-466f-9669-4d0f5980e549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:17.237395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14954af4-1d7e-466f-9669-4d0f5980e549 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:17.237713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14954af4-1d7e-466f-9669-4d0f5980e549 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:17.237961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14954af4-1d7e-466f-9669-4d0f5980e549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:17.304769 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14954af4-1d7e-466f-9669-4d0f5980e549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:17.306254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14954af4-1d7e-466f-9669-4d0f5980e549 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:17.320698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:17.407701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 484/959] 10.222.0.47 () {58 vars in 1282 bytes} [Fri Oct 14 12:50:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:50:17.413561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:17.512112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a8ba7-b90c-4ae4-a150-375667f6b3ed None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:17.544189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:17.544804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:17.545652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:17.545925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:17.555529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:17.556965 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:17.571070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:17.572160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:17.573221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:17.573221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:17.573221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:17.573221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 476/960] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:17.578447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14954af4-1d7e-466f-9669-4d0f5980e549 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:17.679013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14954af4-1d7e-466f-9669-4d0f5980e549 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:17.694242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:17.715418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:17.716019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:17.716293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:17.716561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:17.717801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:17.718108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:17.719461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:17.730263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 485/961] 10.222.0.47 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:17.736373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:17.771461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:17.833412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89143e11-2de2-4061-a432-33a9b570f29d None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:17.865109 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:17.865743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:17.866019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:17.866286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:17.872634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:17.874617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:50:17.885445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:17.886507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: ERROR keystone.server.flask.application Oct 14 12:50:17.887571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 477/962] 10.222.0.47 () {56 vars in 1111 bytes} [Fri Oct 14 12:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:17.892939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:17.988343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5b5fc-8344-4c76-8039-f6e0ce49f482 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:18.021802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00156fc8-c408-40ea-8d24-6c06fb51fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:18.022339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00156fc8-c408-40ea-8d24-6c06fb51fe77 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:18.022616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00156fc8-c408-40ea-8d24-6c06fb51fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:18.022884 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00156fc8-c408-40ea-8d24-6c06fb51fe77 None admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:18.023563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00156fc8-c408-40ea-8d24-6c06fb51fe77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:18.023866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00156fc8-c408-40ea-8d24-6c06fb51fe77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:18.025272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00156fc8-c408-40ea-8d24-6c06fb51fe77 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:18.036846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 486/963] 10.222.0.47 () {56 vars in 1148 bytes} [Fri Oct 14 12:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:18.042790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:18.132210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:18.138268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3b6a2-6b43-4bc6-b844-621759c171d9 None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:18.170528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9b50f-0331-47f9-a436-a9ba1e686d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:18.171119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b50f-0331-47f9-a436-a9ba1e686d06 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:18.171395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b50f-0331-47f9-a436-a9ba1e686d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:18.171659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9b50f-0331-47f9-a436-a9ba1e686d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:18.172372 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9b50f-0331-47f9-a436-a9ba1e686d06 None admin] RBAC: Adding query filter params (role.id=4c6ad52a91ee49469aa1934cdc11b55c, scope.project.id=a39ed153440b4dd9afb3945cfd55fed3, user.id=b4a7dff4f94f4b28ab8e5ae9b7d9aebd) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:18.172676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9b50f-0331-47f9-a436-a9ba1e686d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:18.174213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9b50f-0331-47f9-a436-a9ba1e686d06 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:18.179714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 478/964] 10.222.0.47 () {56 vars in 1374 bytes} [Fri Oct 14 12:50:18 2022] GET /identity/v3/role_assignments?user.id=b4a7dff4f94f4b28ab8e5ae9b7d9aebd&scope.project.id=a39ed153440b4dd9afb3945cfd55fed3&role.id=4c6ad52a91ee49469aa1934cdc11b55c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:20.301769 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31949-6ffe-4d10-aaa7-158b049db8eb None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:20.302261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31949-6ffe-4d10-aaa7-158b049db8eb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:20.302261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31949-6ffe-4d10-aaa7-158b049db8eb None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:20.303531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 487/965] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:20.308690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9febd-c5a4-45e3-a21b-2a230bebfdeb None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:20.309128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9febd-c5a4-45e3-a21b-2a230bebfdeb None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:20.309220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9febd-c5a4-45e3-a21b-2a230bebfdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:20.328000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-71d9febd-c5a4-45e3-a21b-2a230bebfdeb None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:20.329168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-71d9febd-c5a4-45e3-a21b-2a230bebfdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:20.392805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 479/966] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:20.661421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b31949-6ffe-4d10-aaa7-158b049db8eb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:20.695077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:20.769349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b31949-6ffe-4d10-aaa7-158b049db8eb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:20.801658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:20.802270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:20.802542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:20.802804 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:20.803368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:20.804718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:20.813705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:20.814936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:20.816010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 488/967] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Oct 14 12:50:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:20.820734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9febd-c5a4-45e3-a21b-2a230bebfdeb None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:20.907068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:20.916971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9febd-c5a4-45e3-a21b-2a230bebfdeb None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:20.949766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c52b4-dc45-46e5-b95b-82d7e1690f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:20.950358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c52b4-dc45-46e5-b95b-82d7e1690f6b None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:20.950633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c52b4-dc45-46e5-b95b-82d7e1690f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:20.950910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c52b4-dc45-46e5-b95b-82d7e1690f6b None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:20.951535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c52b4-dc45-46e5-b95b-82d7e1690f6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:20.951836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c52b4-dc45-46e5-b95b-82d7e1690f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:20.953179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c52b4-dc45-46e5-b95b-82d7e1690f6b None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:20.957883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 480/968] 10.222.0.47 () {56 vars in 1116 bytes} [Fri Oct 14 12:50:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:20.963506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:21.055508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:21.061633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdec54-63bd-4289-ad6c-cd84402727f7 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:21.093536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e1183-d83e-4ea1-b493-d8dae3ded11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:21.094132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1183-d83e-4ea1-b493-d8dae3ded11b None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:21.094404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1183-d83e-4ea1-b493-d8dae3ded11b None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:21.094670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1183-d83e-4ea1-b493-d8dae3ded11b None admin] PATH_INFO: `/v3/services` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:21.095281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e1183-d83e-4ea1-b493-d8dae3ded11b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:21.095577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e1183-d83e-4ea1-b493-d8dae3ded11b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:21.096919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e1183-d83e-4ea1-b493-d8dae3ded11b None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:21.101157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 489/969] 10.222.0.47 () {56 vars in 1116 bytes} [Fri Oct 14 12:50:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:23.218862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17400f-9274-45ed-9275-882a662567c9 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:23.219374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17400f-9274-45ed-9275-882a662567c9 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:23.219374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17400f-9274-45ed-9275-882a662567c9 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:23.220738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 481/970] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:23.226000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18f443-127a-42e4-886b-5420049ec88f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:23.226402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18f443-127a-42e4-886b-5420049ec88f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:23.226543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18f443-127a-42e4-886b-5420049ec88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:23.244494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3c18f443-127a-42e4-886b-5420049ec88f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:23.245619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3c18f443-127a-42e4-886b-5420049ec88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:23.312220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 490/971] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:23.575895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17400f-9274-45ed-9275-882a662567c9 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:23.677494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17400f-9274-45ed-9275-882a662567c9 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:23.710044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d27ae4-f2d2-4a22-8fea-844551ea3187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:23.710633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27ae4-f2d2-4a22-8fea-844551ea3187 None admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:23.710905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27ae4-f2d2-4a22-8fea-844551ea3187 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:23.711170 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d27ae4-f2d2-4a22-8fea-844551ea3187 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:23.711817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d27ae4-f2d2-4a22-8fea-844551ea3187 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:23.713150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d27ae4-f2d2-4a22-8fea-844551ea3187 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:23.726758 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 482/972] 10.222.0.47 () {60 vars in 1141 bytes} [Fri Oct 14 12:50:23 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:50:25.853778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096becdd-a68e-421b-9897-9888372a1ca8 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:25.854326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096becdd-a68e-421b-9897-9888372a1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:25.854326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096becdd-a68e-421b-9897-9888372a1ca8 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:25.855634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 491/973] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:25.861052 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f872-c3ed-4da7-9268-7c29d52a4265 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:25.861431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f872-c3ed-4da7-9268-7c29d52a4265 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:25.861630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f872-c3ed-4da7-9268-7c29d52a4265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:25.879364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a231f872-c3ed-4da7-9268-7c29d52a4265 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:25.880542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a231f872-c3ed-4da7-9268-7c29d52a4265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:25.890063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:25.952955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 483/974] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:26.220188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096becdd-a68e-421b-9897-9888372a1ca8 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:26.307230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:26.317643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096becdd-a68e-421b-9897-9888372a1ca8 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:26.349995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:26.350602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:26.350874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:26.351139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:26.351702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:26.353043 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:26.362313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:26.363668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:26.364848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 492/975] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Oct 14 12:50:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:26.369163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f872-c3ed-4da7-9268-7c29d52a4265 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:26.462950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f872-c3ed-4da7-9268-7c29d52a4265 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:26.495662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:26.496191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:26.496466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:26.496738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:26.497361 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:26.497728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:26.499135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:26.504205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 484/976] 10.222.0.47 () {56 vars in 1116 bytes} [Fri Oct 14 12:50:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:26.510038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:26.605289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee754e-ebd9-420e-8b63-f66d8e09f781 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:26.637049 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10eda7-8453-48cc-b522-4fa7f7ad8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:26.637652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10eda7-8453-48cc-b522-4fa7f7ad8b98 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:26.637926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10eda7-8453-48cc-b522-4fa7f7ad8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:26.638189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10eda7-8453-48cc-b522-4fa7f7ad8b98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:26.639458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10eda7-8453-48cc-b522-4fa7f7ad8b98 None admin] RBAC: Adding query filter params (interface=public, service_id=74a0e44233aa4c49af0875910fcd8347, region_id=RegionOne) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:26.639778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10eda7-8453-48cc-b522-4fa7f7ad8b98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:26.641259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10eda7-8453-48cc-b522-4fa7f7ad8b98 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:26.647920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 493/977] 10.222.0.47 () {56 vars in 1251 bytes} [Fri Oct 14 12:50:26 2022] GET /identity/v3/endpoints?service_id=74a0e44233aa4c49af0875910fcd8347&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:26.653948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:26.659073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:26.768040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831dcea-3bb4-4690-be35-0fd9bdd5f2cb None admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:26.799584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba1378-13ff-4eb2-9434-077fd1841f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:26.800171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba1378-13ff-4eb2-9434-077fd1841f34 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:26.800443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba1378-13ff-4eb2-9434-077fd1841f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:26.800708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba1378-13ff-4eb2-9434-077fd1841f34 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:26.801298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba1378-13ff-4eb2-9434-077fd1841f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:26.802666 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba1378-13ff-4eb2-9434-077fd1841f34 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:26.809102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 485/978] 10.222.0.47 () {56 vars in 1087 bytes} [Fri Oct 14 12:50:26 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:50:28.932610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb23e-610e-482b-a40c-b4a49050003f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:28.933134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb23e-610e-482b-a40c-b4a49050003f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:28.933134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bb23e-610e-482b-a40c-b4a49050003f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:28.934496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 494/979] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:28.939697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801770-b41e-418a-b370-ab7995da9dde None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:28.940110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801770-b41e-418a-b370-ab7995da9dde None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:28.940242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801770-b41e-418a-b370-ab7995da9dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:28.958606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9f801770-b41e-418a-b370-ab7995da9dde None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:28.959768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9f801770-b41e-418a-b370-ab7995da9dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:29.020487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:29.026274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 486/980] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:29.292116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bb23e-610e-482b-a40c-b4a49050003f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:29.311659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:29.391095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bb23e-610e-482b-a40c-b4a49050003f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:29.423778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:29.424386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:29.424657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:29.424922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:29.425511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:29.426860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:29.435317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:29.436528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: ERROR keystone.server.flask.application Oct 14 12:50:29.437619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 495/981] 10.222.0.47 () {56 vars in 1117 bytes} [Fri Oct 14 12:50:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:29.442460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801770-b41e-418a-b370-ab7995da9dde None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:29.537823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801770-b41e-418a-b370-ab7995da9dde None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:29.570637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de69533-abb2-4efd-bb26-f6407edf9623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:29.571171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de69533-abb2-4efd-bb26-f6407edf9623 None admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:29.571449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de69533-abb2-4efd-bb26-f6407edf9623 None admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:29.571720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de69533-abb2-4efd-bb26-f6407edf9623 None admin] PATH_INFO: `/v3/services` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:29.572348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de69533-abb2-4efd-bb26-f6407edf9623 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:29.572652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de69533-abb2-4efd-bb26-f6407edf9623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:29.574029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de69533-abb2-4efd-bb26-f6407edf9623 None admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:29.579436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 487/982] 10.222.0.47 () {56 vars in 1116 bytes} [Fri Oct 14 12:50:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:29.585118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:29.669048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:29.689717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce2d94-c1c7-4a0b-ad61-50d91e32f934 None admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:29.728000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f94de-5f99-4800-8501-73285b8ebc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:29.728598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f94de-5f99-4800-8501-73285b8ebc02 None admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:29.728871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f94de-5f99-4800-8501-73285b8ebc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:29.729137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f94de-5f99-4800-8501-73285b8ebc02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:29.729833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f94de-5f99-4800-8501-73285b8ebc02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:29.731184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f94de-5f99-4800-8501-73285b8ebc02 None admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:29.750011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 496/983] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:50:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:50:39.576926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=69 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:39.748754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:33.227616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cacd86-1d11-441f-9fa1-3927843b7d3c None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:33.228072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cacd86-1d11-441f-9fa1-3927843b7d3c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:33.228152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cacd86-1d11-441f-9fa1-3927843b7d3c None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:33.233795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 488/984] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:33.235179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1b6d-57e6-4919-bf57-7722e0fed35c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:33.235602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1b6d-57e6-4919-bf57-7722e0fed35c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:33.235780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1b6d-57e6-4919-bf57-7722e0fed35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:33.385317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c25f1b6d-57e6-4919-bf57-7722e0fed35c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:33.388520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c25f1b6d-57e6-4919-bf57-7722e0fed35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:33.555814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 497/985] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:51:33.853470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22d4fd-683e-485d-80af-c881db22324d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:33.853876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22d4fd-683e-485d-80af-c881db22324d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:33.854154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22d4fd-683e-485d-80af-c881db22324d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:33.856319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 489/986] 10.222.0.47 () {54 vars in 964 bytes} [Fri Oct 14 12:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:33.863500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c2b3-1f2b-46e4-b6c4-2dc5de98ae4b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:33.864226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c2b3-1f2b-46e4-b6c4-2dc5de98ae4b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:33.864676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3c2b3-1f2b-46e4-b6c4-2dc5de98ae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:33.953167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-92e3c2b3-1f2b-46e4-b6c4-2dc5de98ae4b None None] MFA Rules not processed for user `899319384b8b471f8d308f37be459c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:33.954620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-92e3c2b3-1f2b-46e4-b6c4-2dc5de98ae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:33.976822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:34.045386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 498/987] 10.222.0.47 () {58 vars in 1061 bytes} [Fri Oct 14 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:34.054560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22d4fd-683e-485d-80af-c881db22324d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:34.056599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2a22d4fd-683e-485d-80af-c881db22324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:34.174406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22d4fd-683e-485d-80af-c881db22324d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:34.260041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd1a78-a0ab-4900-922c-6789fc7e86e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:34.262336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1a78-a0ab-4900-922c-6789fc7e86e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:34.263162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1a78-a0ab-4900-922c-6789fc7e86e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:34.263672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd1a78-a0ab-4900-922c-6789fc7e86e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:34.265499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bbdd1a78-a0ab-4900-922c-6789fc7e86e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:34.344376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:34.406252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd1a78-a0ab-4900-922c-6789fc7e86e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:34.407854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd1a78-a0ab-4900-922c-6789fc7e86e5 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:34.442759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 490/988] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:51:36.926383 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7c41-528e-4bd4-9de8-507dc4e2df87 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:36.926932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7c41-528e-4bd4-9de8-507dc4e2df87 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:36.926932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7c41-528e-4bd4-9de8-507dc4e2df87 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:36.928260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 499/989] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:36.933904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09f19a-a315-4037-8378-65887b70f162 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:36.934301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09f19a-a315-4037-8378-65887b70f162 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:36.934437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09f19a-a315-4037-8378-65887b70f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:37.014699 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-df09f19a-a315-4037-8378-65887b70f162 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:37.015889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-df09f19a-a315-4037-8378-65887b70f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:37.109375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 491/990] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:37.393297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f7c41-528e-4bd4-9de8-507dc4e2df87 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:37.394844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c16f7c41-528e-4bd4-9de8-507dc4e2df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:37.496759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f7c41-528e-4bd4-9de8-507dc4e2df87 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:37.566725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:37.569235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff61fcd-989a-40a4-bb00-3d894df27479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:37.570066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61fcd-989a-40a4-bb00-3d894df27479 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:37.570360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61fcd-989a-40a4-bb00-3d894df27479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:37.570807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61fcd-989a-40a4-bb00-3d894df27479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:37.572592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cff61fcd-989a-40a4-bb00-3d894df27479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:37.688938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff61fcd-989a-40a4-bb00-3d894df27479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:37.690643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff61fcd-989a-40a4-bb00-3d894df27479 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:37.709783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 500/991] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:51:40.162877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9181d-74ed-4704-97a9-9c2c6ff36d7b None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:40.163414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9181d-74ed-4704-97a9-9c2c6ff36d7b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:40.163540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9181d-74ed-4704-97a9-9c2c6ff36d7b None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:40.164769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 492/992] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:40.170019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257b4b-007f-48e5-9491-7bbf302c01c9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:40.170439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257b4b-007f-48e5-9491-7bbf302c01c9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:40.170574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257b4b-007f-48e5-9491-7bbf302c01c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:40.236822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-40257b4b-007f-48e5-9491-7bbf302c01c9 None None] MFA Rules not processed for user `e4a45d0a115d4bc794657fc46219ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:40.237975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-40257b4b-007f-48e5-9491-7bbf302c01c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:40.289404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:40.333919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 501/993] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:40.616389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9181d-74ed-4704-97a9-9c2c6ff36d7b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:40.617937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7de9181d-74ed-4704-97a9-9c2c6ff36d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:40.628876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:40.721165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9181d-74ed-4704-97a9-9c2c6ff36d7b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:40.791438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f85efb-09bb-4bec-a736-9684078bb3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:40.792547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85efb-09bb-4bec-a736-9684078bb3ab service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:40.792813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85efb-09bb-4bec-a736-9684078bb3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:40.793075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85efb-09bb-4bec-a736-9684078bb3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:40.794662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-09f85efb-09bb-4bec-a736-9684078bb3ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:40.855558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:40.901505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f85efb-09bb-4bec-a736-9684078bb3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:40.902846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f85efb-09bb-4bec-a736-9684078bb3ab service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:40.920991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 493/994] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:51:43.577867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadfd5-df0c-4a2f-9ae2-968b405ecd39 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:43.578394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadfd5-df0c-4a2f-9ae2-968b405ecd39 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:43.578394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadfd5-df0c-4a2f-9ae2-968b405ecd39 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:43.579753 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 502/995] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:43.584935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3d70-01ff-4ccf-a585-eed92f27d29b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:43.585372 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3d70-01ff-4ccf-a585-eed92f27d29b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:43.585463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3d70-01ff-4ccf-a585-eed92f27d29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:43.649362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2a9c3d70-01ff-4ccf-a585-eed92f27d29b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:43.650689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2a9c3d70-01ff-4ccf-a585-eed92f27d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:43.746078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 494/996] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:44.028004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceadfd5-df0c-4a2f-9ae2-968b405ecd39 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:44.029565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2ceadfd5-df0c-4a2f-9ae2-968b405ecd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:44.129464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceadfd5-df0c-4a2f-9ae2-968b405ecd39 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:44.200381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab074a9f-ac01-46ae-8d1f-073d1d0e6f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:44.201022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074a9f-ac01-46ae-8d1f-073d1d0e6f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:44.201295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074a9f-ac01-46ae-8d1f-073d1d0e6f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:44.201586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab074a9f-ac01-46ae-8d1f-073d1d0e6f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:44.203134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ab074a9f-ac01-46ae-8d1f-073d1d0e6f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:44.209812 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:44.309887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab074a9f-ac01-46ae-8d1f-073d1d0e6f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:44.311226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab074a9f-ac01-46ae-8d1f-073d1d0e6f71 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:44.329675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 503/997] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:51:47.099064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4041-ba82-448e-b0b7-1714095c9973 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:47.099577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4041-ba82-448e-b0b7-1714095c9973 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:47.099669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4041-ba82-448e-b0b7-1714095c9973 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:47.101080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 495/998] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:47.106910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f16ce-78a9-417b-ace7-cb2ecc9825a3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:47.107313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f16ce-78a9-417b-ace7-cb2ecc9825a3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:47.107559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f16ce-78a9-417b-ace7-cb2ecc9825a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:47.180341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e71f16ce-78a9-417b-ace7-cb2ecc9825a3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:47.181629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e71f16ce-78a9-417b-ace7-cb2ecc9825a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:47.242475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:47.284628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 504/999] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:47.564666 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f4041-ba82-448e-b0b7-1714095c9973 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:47.566239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-952f4041-ba82-448e-b0b7-1714095c9973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:47.586234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:47.672961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f4041-ba82-448e-b0b7-1714095c9973 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:47.745975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b09fb-99e3-4da2-8773-437cc9ee4726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:47.746592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b09fb-99e3-4da2-8773-437cc9ee4726 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:47.746864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b09fb-99e3-4da2-8773-437cc9ee4726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:47.747131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b09fb-99e3-4da2-8773-437cc9ee4726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:47.748739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e31b09fb-99e3-4da2-8773-437cc9ee4726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:47.819163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:47.857739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b09fb-99e3-4da2-8773-437cc9ee4726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:47.859435 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b09fb-99e3-4da2-8773-437cc9ee4726 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:47.877618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 496/1000] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:51:50.062730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b43d2-b668-4236-a83b-764ff79b9873 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:50.063258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b43d2-b668-4236-a83b-764ff79b9873 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:50.063258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b43d2-b668-4236-a83b-764ff79b9873 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:50.064597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 505/1001] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:50.069749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e5ed-a67d-432c-8c08-c8727d9e2179 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:50.070153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e5ed-a67d-432c-8c08-c8727d9e2179 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:50.070306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1e5ed-a67d-432c-8c08-c8727d9e2179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:50.136396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-59f1e5ed-a67d-432c-8c08-c8727d9e2179 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:50.137615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-59f1e5ed-a67d-432c-8c08-c8727d9e2179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:50.240938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 497/1002] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:50.521311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b43d2-b668-4236-a83b-764ff79b9873 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:50.522859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-009b43d2-b668-4236-a83b-764ff79b9873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:50.624313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b43d2-b668-4236-a83b-764ff79b9873 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:50.697915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521a156-9b7f-477c-a786-d866ce6c0ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:50.698497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a156-9b7f-477c-a786-d866ce6c0ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:50.698767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a156-9b7f-477c-a786-d866ce6c0ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:50.699031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a156-9b7f-477c-a786-d866ce6c0ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:50.700588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6521a156-9b7f-477c-a786-d866ce6c0ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:50.717771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:50.813065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521a156-9b7f-477c-a786-d866ce6c0ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:50.814437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521a156-9b7f-477c-a786-d866ce6c0ab2 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:50.832994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 506/1003] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:51:53.044755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a51ba-192d-4dc7-8e63-bfbc8cc318fd None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:53.045249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a51ba-192d-4dc7-8e63-bfbc8cc318fd None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:53.045341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a51ba-192d-4dc7-8e63-bfbc8cc318fd None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:53.046657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 498/1004] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:53.051979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9f855-b1a7-43bb-bacf-1b76dbe37673 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:53.052389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9f855-b1a7-43bb-bacf-1b76dbe37673 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:53.052482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9f855-b1a7-43bb-bacf-1b76dbe37673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:53.118152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-49f9f855-b1a7-43bb-bacf-1b76dbe37673 None None] MFA Rules not processed for user `e4a45d0a115d4bc794657fc46219ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:53.119816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-49f9f855-b1a7-43bb-bacf-1b76dbe37673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:53.184151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:53.216912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 507/1005] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:53.498365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a51ba-192d-4dc7-8e63-bfbc8cc318fd None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:53.499884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-649a51ba-192d-4dc7-8e63-bfbc8cc318fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:53.532765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:53.609981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a51ba-192d-4dc7-8e63-bfbc8cc318fd None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:53.688710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdbd4c-0b39-4543-81a1-72efdce6b098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:53.689321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbd4c-0b39-4543-81a1-72efdce6b098 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:53.689627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbd4c-0b39-4543-81a1-72efdce6b098 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:53.689897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdbd4c-0b39-4543-81a1-72efdce6b098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:53.691473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-72fdbd4c-0b39-4543-81a1-72efdce6b098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:53.770476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:53.802385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdbd4c-0b39-4543-81a1-72efdce6b098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:53.803807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdbd4c-0b39-4543-81a1-72efdce6b098 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:53.823157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 499/1006] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:51:56.199515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417d6b-aef0-4414-814a-393c956ae82c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:56.200095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417d6b-aef0-4414-814a-393c956ae82c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:56.200095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30417d6b-aef0-4414-814a-393c956ae82c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:56.201377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 508/1007] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:56.206524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93a576-4637-49ce-be55-16fa155b32ce None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:56.206928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93a576-4637-49ce-be55-16fa155b32ce None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:56.207064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93a576-4637-49ce-be55-16fa155b32ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:56.271704 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-6d93a576-4637-49ce-be55-16fa155b32ce None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:56.272820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6d93a576-4637-49ce-be55-16fa155b32ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:56.366249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 500/1008] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:56.660441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30417d6b-aef0-4414-814a-393c956ae82c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:56.662003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-30417d6b-aef0-4414-814a-393c956ae82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:56.765960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30417d6b-aef0-4414-814a-393c956ae82c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:56.837153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4d677-dfb9-4174-8477-bd338c00249e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:56.837771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d677-dfb9-4174-8477-bd338c00249e service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:56.838560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d677-dfb9-4174-8477-bd338c00249e service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:56.838825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4d677-dfb9-4174-8477-bd338c00249e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:56.840372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a7c4d677-dfb9-4174-8477-bd338c00249e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:56.866938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:56.948187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4d677-dfb9-4174-8477-bd338c00249e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:56.948722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4d677-dfb9-4174-8477-bd338c00249e service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:56.966950 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 509/1009] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:51:59.139704 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095b486-e91a-4a3e-bdb7-b8135b4e2f70 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:59.140261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095b486-e91a-4a3e-bdb7-b8135b4e2f70 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:59.140261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095b486-e91a-4a3e-bdb7-b8135b4e2f70 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:59.141622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 501/1010] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:59.146707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66f28-39da-4bdb-8469-3e7c11f7379a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:59.147116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66f28-39da-4bdb-8469-3e7c11f7379a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:59.147241 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66f28-39da-4bdb-8469-3e7c11f7379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:59.210590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a2d66f28-39da-4bdb-8469-3e7c11f7379a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:59.211765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a2d66f28-39da-4bdb-8469-3e7c11f7379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:59.283980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:59.305345 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 510/1011] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:51:59.594875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095b486-e91a-4a3e-bdb7-b8135b4e2f70 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:59.596436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4095b486-e91a-4a3e-bdb7-b8135b4e2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:59.637381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:59.699454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095b486-e91a-4a3e-bdb7-b8135b4e2f70 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:59.772157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08d549-594f-4303-a1e9-f52b88b59e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:59.772749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d549-594f-4303-a1e9-f52b88b59e0e service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:59.773020 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d549-594f-4303-a1e9-f52b88b59e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:59.773291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d549-594f-4303-a1e9-f52b88b59e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:59.774958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5a08d549-594f-4303-a1e9-f52b88b59e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:59.855887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:59.881689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08d549-594f-4303-a1e9-f52b88b59e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:59.883104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08d549-594f-4303-a1e9-f52b88b59e0e service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:59.901438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 502/1012] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:02.367993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a7036-413e-4ced-bf1d-e47657ff9f52 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:02.368530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a7036-413e-4ced-bf1d-e47657ff9f52 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:02.368530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a7036-413e-4ced-bf1d-e47657ff9f52 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:02.370407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 511/1013] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:02.375448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b265e-bdec-4202-ab31-dbeae147fe32 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:02.375883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b265e-bdec-4202-ab31-dbeae147fe32 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:02.375991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b265e-bdec-4202-ab31-dbeae147fe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:02.441090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f53b265e-bdec-4202-ab31-dbeae147fe32 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:02.442323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f53b265e-bdec-4202-ab31-dbeae147fe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:02.537141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 503/1014] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:02.824301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a7036-413e-4ced-bf1d-e47657ff9f52 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:02.825888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ab9a7036-413e-4ced-bf1d-e47657ff9f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:02.929197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a7036-413e-4ced-bf1d-e47657ff9f52 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:03.002623 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f908489-c904-4c5e-89bb-0147316da883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:03.003231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908489-c904-4c5e-89bb-0147316da883 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:03.003504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908489-c904-4c5e-89bb-0147316da883 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:03.003773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f908489-c904-4c5e-89bb-0147316da883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:03.005339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4f908489-c904-4c5e-89bb-0147316da883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:03.039848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:03.112948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908489-c904-4c5e-89bb-0147316da883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:03.114518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f908489-c904-4c5e-89bb-0147316da883 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:03.133388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 512/1015] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:07.146971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4df2f-bcf0-430d-a6d4-24a194112f23 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:07.147517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4df2f-bcf0-430d-a6d4-24a194112f23 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:07.147517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4df2f-bcf0-430d-a6d4-24a194112f23 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:07.148850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 504/1016] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:07.154303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e96f-27fb-41cb-ba3d-298d3c3cb559 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:07.154692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e96f-27fb-41cb-ba3d-298d3c3cb559 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:07.154855 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e96f-27fb-41cb-ba3d-298d3c3cb559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:07.220791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1f90e96f-27fb-41cb-ba3d-298d3c3cb559 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:07.221915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1f90e96f-27fb-41cb-ba3d-298d3c3cb559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:07.308783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:07.320278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 513/1017] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:07.606152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4df2f-bcf0-430d-a6d4-24a194112f23 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:07.607680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-62b4df2f-bcf0-430d-a6d4-24a194112f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:07.658275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:07.718141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4df2f-bcf0-430d-a6d4-24a194112f23 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:07.790303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b46015-f3c6-4910-a1a2-a563bf0b8c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:07.791425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46015-f3c6-4910-a1a2-a563bf0b8c4f service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:07.791697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46015-f3c6-4910-a1a2-a563bf0b8c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:07.791962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b46015-f3c6-4910-a1a2-a563bf0b8c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:07.793558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f8b46015-f3c6-4910-a1a2-a563bf0b8c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:07.889378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:07.907298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b46015-f3c6-4910-a1a2-a563bf0b8c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:07.908719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b46015-f3c6-4910-a1a2-a563bf0b8c4f service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:07.926380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 505/1018] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:10.732579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478302e-2c8b-49ad-99c5-4ceab89e1e12 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:10.732973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478302e-2c8b-49ad-99c5-4ceab89e1e12 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:10.733402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478302e-2c8b-49ad-99c5-4ceab89e1e12 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:10.734786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 514/1019] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:10.740010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef254c4-4233-460c-b37d-c54dc1273a31 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:10.740455 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef254c4-4233-460c-b37d-c54dc1273a31 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:10.740549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef254c4-4233-460c-b37d-c54dc1273a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:10.807020 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-fef254c4-4233-460c-b37d-c54dc1273a31 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:10.808230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-fef254c4-4233-460c-b37d-c54dc1273a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:10.903755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 506/1020] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:52:11.186441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478302e-2c8b-49ad-99c5-4ceab89e1e12 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:11.188063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d478302e-2c8b-49ad-99c5-4ceab89e1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:11.294337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478302e-2c8b-49ad-99c5-4ceab89e1e12 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:11.371297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2e3b5-41c9-4142-8174-7e686eea3801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:11.371898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e3b5-41c9-4142-8174-7e686eea3801 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:11.372175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e3b5-41c9-4142-8174-7e686eea3801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:11.372444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2e3b5-41c9-4142-8174-7e686eea3801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:11.374050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-eae2e3b5-41c9-4142-8174-7e686eea3801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:11.417023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:11.484863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2e3b5-41c9-4142-8174-7e686eea3801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:11.486267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2e3b5-41c9-4142-8174-7e686eea3801 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:11.504704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 515/1021] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:52:15.592677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514c17-895c-4312-b3b6-1b85fc54a2fd None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:15.593175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514c17-895c-4312-b3b6-1b85fc54a2fd None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:15.593266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514c17-895c-4312-b3b6-1b85fc54a2fd None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:15.594558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 507/1022] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:15.599721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b746-6793-40c0-b055-a80526650de3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:15.600155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b746-6793-40c0-b055-a80526650de3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:15.600249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b746-6793-40c0-b055-a80526650de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:15.670101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2a75b746-6793-40c0-b055-a80526650de3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:15.671302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2a75b746-6793-40c0-b055-a80526650de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:15.766905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:15.769273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 516/1023] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:16.063641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b220-4fcf-483e-81dd-74561138d939 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:16.063924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b220-4fcf-483e-81dd-74561138d939 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:16.064192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b220-4fcf-483e-81dd-74561138d939 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:16.065532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 508/1024] 10.222.0.47 () {54 vars in 964 bytes} [Fri Oct 14 12:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:16.071376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a3599-013c-43ee-9429-c6d23d9cfc67 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:16.071684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a3599-013c-43ee-9429-c6d23d9cfc67 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:16.071954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a3599-013c-43ee-9429-c6d23d9cfc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:16.145667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5c3a3599-013c-43ee-9429-c6d23d9cfc67 None None] MFA Rules not processed for user `899319384b8b471f8d308f37be459c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:16.146848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5c3a3599-013c-43ee-9429-c6d23d9cfc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:16.219835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 517/1025] 10.222.0.47 () {58 vars in 1061 bytes} [Fri Oct 14 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:16.229347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8b220-4fcf-483e-81dd-74561138d939 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:16.230804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-95b8b220-4fcf-483e-81dd-74561138d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:16.287270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:16.333966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8b220-4fcf-483e-81dd-74561138d939 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:16.406085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f0995-5694-4f60-bf5b-f0acccb83dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:16.406679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f0995-5694-4f60-bf5b-f0acccb83dfe service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:16.406955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f0995-5694-4f60-bf5b-f0acccb83dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:16.407223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f0995-5694-4f60-bf5b-f0acccb83dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:16.408792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-896f0995-5694-4f60-bf5b-f0acccb83dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:16.512335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:16.516365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f0995-5694-4f60-bf5b-f0acccb83dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:16.517823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f0995-5694-4f60-bf5b-f0acccb83dfe service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:16.536574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 509/1026] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:21.809294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d880de-a88f-47eb-a0dd-66ca118b5514 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:21.809857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d880de-a88f-47eb-a0dd-66ca118b5514 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:21.810043 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d880de-a88f-47eb-a0dd-66ca118b5514 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:21.811573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 518/1027] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 12:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:21.817003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad357-1a21-4cd6-b9a1-f882797511db None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:21.817986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad357-1a21-4cd6-b9a1-f882797511db None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:21.818475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad357-1a21-4cd6-b9a1-f882797511db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:21.972130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-769ad357-1a21-4cd6-b9a1-f882797511db None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:21.973320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-769ad357-1a21-4cd6-b9a1-f882797511db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:22.101711 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 510/1028] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:26.206787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4a97-1be7-4f1e-996f-099c7c59fcd8 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:26.207697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4a97-1be7-4f1e-996f-099c7c59fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:26.208034 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef4a97-1be7-4f1e-996f-099c7c59fcd8 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:26.210090 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 519/1029] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 12:52:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:26.214996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177fb2f-7f33-448d-876d-a478a5b1c182 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:26.215437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177fb2f-7f33-448d-876d-a478a5b1c182 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:26.215531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177fb2f-7f33-448d-876d-a478a5b1c182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:26.218238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=59 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:26.277068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:26.304387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0177fb2f-7f33-448d-876d-a478a5b1c182 None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:26.305143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0177fb2f-7f33-448d-876d-a478a5b1c182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:26.430469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 511/1030] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:27.798037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6c50-6425-4da0-b28a-e5c5e8bcaa74 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:27.798559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6c50-6425-4da0-b28a-e5c5e8bcaa74 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:27.798559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6c50-6425-4da0-b28a-e5c5e8bcaa74 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:27.799926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 520/1031] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 12:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:27.804993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a08ab1-16df-448a-94b4-f0d3730cb10a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:27.805385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a08ab1-16df-448a-94b4-f0d3730cb10a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:27.806148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a08ab1-16df-448a-94b4-f0d3730cb10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:27.881384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-82a08ab1-16df-448a-94b4-f0d3730cb10a None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:27.882616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-82a08ab1-16df-448a-94b4-f0d3730cb10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:27.923478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:27.990767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 512/1032] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:31.451046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c62142-20ec-41e9-ad52-9addcbd6b48a None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:31.451847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c62142-20ec-41e9-ad52-9addcbd6b48a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:31.452282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c62142-20ec-41e9-ad52-9addcbd6b48a None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:31.454052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 521/1033] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:31.459440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee328-5e9f-43cf-a519-6881af67c972 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:31.460270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee328-5e9f-43cf-a519-6881af67c972 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:31.460763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee328-5e9f-43cf-a519-6881af67c972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:31.533701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-290ee328-5e9f-43cf-a519-6881af67c972 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:31.534969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-290ee328-5e9f-43cf-a519-6881af67c972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:31.636050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 513/1034] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:31.938063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326d784-36fb-42c7-b68d-ab6c21eb204e None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:31.938890 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326d784-36fb-42c7-b68d-ab6c21eb204e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:31.939432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326d784-36fb-42c7-b68d-ab6c21eb204e None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:31.941191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 522/1035] 10.222.0.47 () {54 vars in 961 bytes} [Fri Oct 14 12:52:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:31.950609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78126-fb0b-49ce-b7bf-03d1e61a44cf None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:31.950894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78126-fb0b-49ce-b7bf-03d1e61a44cf None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:31.951163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b78126-fb0b-49ce-b7bf-03d1e61a44cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:31.969370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:32.057631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-72b78126-fb0b-49ce-b7bf-03d1e61a44cf None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:32.058860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-72b78126-fb0b-49ce-b7bf-03d1e61a44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:32.195979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 514/1036] 10.222.0.47 () {58 vars in 1058 bytes} [Fri Oct 14 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:32.203672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326d784-36fb-42c7-b68d-ab6c21eb204e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:32.205330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b326d784-36fb-42c7-b68d-ab6c21eb204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:32.364257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326d784-36fb-42c7-b68d-ab6c21eb204e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:32.443388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:32.487972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e42cd9-7628-4989-a848-05b603dbf9ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:32.488560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e42cd9-7628-4989-a848-05b603dbf9ff service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:32.488809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e42cd9-7628-4989-a848-05b603dbf9ff service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:32.489007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e42cd9-7628-4989-a848-05b603dbf9ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:32.490590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b1e42cd9-7628-4989-a848-05b603dbf9ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:32.596157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e42cd9-7628-4989-a848-05b603dbf9ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:32.597958 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e42cd9-7628-4989-a848-05b603dbf9ff service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:32.617795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 523/1037] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:52:34.996077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c017d-8a0c-42ba-879c-85bbeab476f9 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:34.996976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c017d-8a0c-42ba-879c-85bbeab476f9 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:34.997358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c017d-8a0c-42ba-879c-85bbeab476f9 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:34.999011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 515/1038] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:35.004561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f90ed-fa68-4efb-bdf6-d2d0f2cf38f9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:35.005052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f90ed-fa68-4efb-bdf6-d2d0f2cf38f9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:35.005052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f90ed-fa68-4efb-bdf6-d2d0f2cf38f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:35.104723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9e4f90ed-fa68-4efb-bdf6-d2d0f2cf38f9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:35.106067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9e4f90ed-fa68-4efb-bdf6-d2d0f2cf38f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:35.156349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:35.221299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 524/1039] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:52:35.509529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c017d-8a0c-42ba-879c-85bbeab476f9 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:35.511056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-342c017d-8a0c-42ba-879c-85bbeab476f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:35.584705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:35.694993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c017d-8a0c-42ba-879c-85bbeab476f9 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:35.830665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90cca1-7423-44d1-a45d-4af18fa857c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:35.831352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90cca1-7423-44d1-a45d-4af18fa857c4 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:35.831627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90cca1-7423-44d1-a45d-4af18fa857c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:35.831891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90cca1-7423-44d1-a45d-4af18fa857c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:35.833470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3d90cca1-7423-44d1-a45d-4af18fa857c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:35.855887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:35.927260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90cca1-7423-44d1-a45d-4af18fa857c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:35.928777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90cca1-7423-44d1-a45d-4af18fa857c4 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:35.948248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 516/1040] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:52:38.449307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c454-f7b0-429d-a7f9-b847ac982608 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:38.450248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c454-f7b0-429d-a7f9-b847ac982608 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:38.450528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c454-f7b0-429d-a7f9-b847ac982608 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:38.452088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 525/1041] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:38.457450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009c8a-2ab1-4ff5-b0e1-b6ed0b0fba83 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:38.457874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009c8a-2ab1-4ff5-b0e1-b6ed0b0fba83 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:38.458048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009c8a-2ab1-4ff5-b0e1-b6ed0b0fba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:38.530182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c0009c8a-2ab1-4ff5-b0e1-b6ed0b0fba83 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:38.531402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c0009c8a-2ab1-4ff5-b0e1-b6ed0b0fba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:38.628913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:38.634652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 517/1042] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:38.928073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1b198-a3f2-415f-bd50-a24826293fa2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:38.928360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1b198-a3f2-415f-bd50-a24826293fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:38.928633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1b198-a3f2-415f-bd50-a24826293fa2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:38.930128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 526/1043] 10.222.0.47 () {54 vars in 961 bytes} [Fri Oct 14 12:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:38.935945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7944-4fbb-456b-ad4a-b76d32887a92 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:38.936365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7944-4fbb-456b-ad4a-b76d32887a92 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:38.936764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc7944-4fbb-456b-ad4a-b76d32887a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:39.020717 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9ffc7944-4fbb-456b-ad4a-b76d32887a92 None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:39.021922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9ffc7944-4fbb-456b-ad4a-b76d32887a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:39.144316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 518/1044] 10.222.0.47 () {58 vars in 1058 bytes} [Fri Oct 14 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:39.152330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1b198-a3f2-415f-bd50-a24826293fa2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:39.153922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-80e1b198-a3f2-415f-bd50-a24826293fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:39.312765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1b198-a3f2-415f-bd50-a24826293fa2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:39.334099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:39.438644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb4321-3146-42f4-90df-39013f5b8b11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:39.439249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb4321-3146-42f4-90df-39013f5b8b11 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:39.439520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb4321-3146-42f4-90df-39013f5b8b11 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:39.439783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb4321-3146-42f4-90df-39013f5b8b11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:39.441331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2fbb4321-3146-42f4-90df-39013f5b8b11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:39.539239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb4321-3146-42f4-90df-39013f5b8b11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:39.541661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb4321-3146-42f4-90df-39013f5b8b11 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:39.563931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 527/1045] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:39.670379 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f08a0-2f1e-4f03-9157-d09e036e317b None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:39.670994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f08a0-2f1e-4f03-9157-d09e036e317b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:39.670994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f08a0-2f1e-4f03-9157-d09e036e317b None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:39.672256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 519/1046] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:39.685723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a918-6dff-4ddb-8240-1d5ed72e9d31 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:39.685723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a918-6dff-4ddb-8240-1d5ed72e9d31 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:39.685723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6a918-6dff-4ddb-8240-1d5ed72e9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:39.719658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:39.766935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5da6a918-6dff-4ddb-8240-1d5ed72e9d31 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:39.770493 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5da6a918-6dff-4ddb-8240-1d5ed72e9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:39.907853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 528/1047] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:40.257128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93b0c-28e6-447b-aaef-c9c2fa531a62 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:40.257412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93b0c-28e6-447b-aaef-c9c2fa531a62 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:40.257723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93b0c-28e6-447b-aaef-c9c2fa531a62 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:40.259239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 520/1048] 10.222.0.47 () {54 vars in 963 bytes} [Fri Oct 14 12:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:40.264506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712f93a-8b5b-41f4-85ad-1672616fb525 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:40.264856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712f93a-8b5b-41f4-85ad-1672616fb525 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:40.265196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712f93a-8b5b-41f4-85ad-1672616fb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:40.348184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e712f93a-8b5b-41f4-85ad-1672616fb525 None None] MFA Rules not processed for user `99e3385f7c3948f9ab871233626c3257`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:40.349410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e712f93a-8b5b-41f4-85ad-1672616fb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:40.401899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:40.435991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 529/1049] 10.222.0.47 () {58 vars in 1060 bytes} [Fri Oct 14 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:40.442234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b93b0c-28e6-447b-aaef-c9c2fa531a62 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:40.443735 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d9b93b0c-28e6-447b-aaef-c9c2fa531a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:40.499507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:40.558598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b93b0c-28e6-447b-aaef-c9c2fa531a62 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:40.652341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7991e72-f319-4115-b824-aa574b8f042a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:40.653231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991e72-f319-4115-b824-aa574b8f042a service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:40.653231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991e72-f319-4115-b824-aa574b8f042a service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:40.653473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991e72-f319-4115-b824-aa574b8f042a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:40.655217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e7991e72-f319-4115-b824-aa574b8f042a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:40.770821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:40.786357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7991e72-f319-4115-b824-aa574b8f042a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:40.787727 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7991e72-f319-4115-b824-aa574b8f042a service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:40.808348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 521/1050] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:52:41.882962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038acd-e388-4484-b9e8-038b7a8c3f9b None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:41.883516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038acd-e388-4484-b9e8-038b7a8c3f9b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:41.883516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b038acd-e388-4484-b9e8-038b7a8c3f9b None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:41.884841 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 530/1051] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:41.890273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7a0d3-1ed8-4ba9-8758-60eaf25f0307 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:41.890672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7a0d3-1ed8-4ba9-8758-60eaf25f0307 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:41.890807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7a0d3-1ed8-4ba9-8758-60eaf25f0307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:41.956152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-50a7a0d3-1ed8-4ba9-8758-60eaf25f0307 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:41.957703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-50a7a0d3-1ed8-4ba9-8758-60eaf25f0307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:42.066040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 522/1052] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:42.362187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b038acd-e388-4484-b9e8-038b7a8c3f9b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:42.363709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7b038acd-e388-4484-b9e8-038b7a8c3f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:42.516395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b038acd-e388-4484-b9e8-038b7a8c3f9b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:42.573789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:42.640812 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb5012-e4ec-40b2-aa2e-607d21f8f20f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:42.641424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb5012-e4ec-40b2-aa2e-607d21f8f20f service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:42.642144 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb5012-e4ec-40b2-aa2e-607d21f8f20f service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:42.642144 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb5012-e4ec-40b2-aa2e-607d21f8f20f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:42.643600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-77fb5012-e4ec-40b2-aa2e-607d21f8f20f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:42.739756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb5012-e4ec-40b2-aa2e-607d21f8f20f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:42.741357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb5012-e4ec-40b2-aa2e-607d21f8f20f service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:42.763482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 531/1053] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:45.027869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52523e-6add-4be2-ba2d-e74427068961 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:45.028402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52523e-6add-4be2-ba2d-e74427068961 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:45.028590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52523e-6add-4be2-ba2d-e74427068961 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:45.030079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 523/1054] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:45.035713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a78de-b603-43e6-9853-2129866edbe8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:45.036317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a78de-b603-43e6-9853-2129866edbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:45.036317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a78de-b603-43e6-9853-2129866edbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:45.111164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-510a78de-b603-43e6-9853-2129866edbe8 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:45.112369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-510a78de-b603-43e6-9853-2129866edbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:45.120010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:45.216293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 532/1055] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:45.504799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52523e-6add-4be2-ba2d-e74427068961 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:45.506611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-eb52523e-6add-4be2-ba2d-e74427068961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:45.571082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:45.664169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52523e-6add-4be2-ba2d-e74427068961 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:45.786740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618fd0f-942e-4a86-bc27-2da780a28bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:45.787259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fd0f-942e-4a86-bc27-2da780a28bf4 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:45.787535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fd0f-942e-4a86-bc27-2da780a28bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:45.787940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618fd0f-942e-4a86-bc27-2da780a28bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:45.789577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c618fd0f-942e-4a86-bc27-2da780a28bf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:45.810072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:45.887889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618fd0f-942e-4a86-bc27-2da780a28bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:45.889504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618fd0f-942e-4a86-bc27-2da780a28bf4 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:45.908461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 524/1056] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:48.131288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb66be-6fbd-4f9a-bf72-c1f9dbf3a8ca None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:48.131737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb66be-6fbd-4f9a-bf72-c1f9dbf3a8ca None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:48.131815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb66be-6fbd-4f9a-bf72-c1f9dbf3a8ca None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:48.134131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 533/1057] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:48.139268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ede5b-ed1b-4984-af84-91736893fe04 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:48.139672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ede5b-ed1b-4984-af84-91736893fe04 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:48.139833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ede5b-ed1b-4984-af84-91736893fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:48.240991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-cd2ede5b-ed1b-4984-af84-91736893fe04 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:48.243702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cd2ede5b-ed1b-4984-af84-91736893fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:48.356186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:48.369515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 525/1058] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:48.734020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb66be-6fbd-4f9a-bf72-c1f9dbf3a8ca None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:48.735524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-badb66be-6fbd-4f9a-bf72-c1f9dbf3a8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:48.901371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:48.915173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb66be-6fbd-4f9a-bf72-c1f9dbf3a8ca None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:49.059312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8b92d-7dfc-43f1-be25-e16df29397d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:49.059965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8b92d-7dfc-43f1-be25-e16df29397d9 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:49.060210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8b92d-7dfc-43f1-be25-e16df29397d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:49.060491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8b92d-7dfc-43f1-be25-e16df29397d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:49.062542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fbd8b92d-7dfc-43f1-be25-e16df29397d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:49.161526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8b92d-7dfc-43f1-be25-e16df29397d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:49.163142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8b92d-7dfc-43f1-be25-e16df29397d9 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:49.173367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:49.182628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 534/1059] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:51.527936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7b62-5724-41e7-b748-3123028993d4 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:51.528497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7b62-5724-41e7-b748-3123028993d4 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:51.528728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7b62-5724-41e7-b748-3123028993d4 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:51.530520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 526/1060] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:51.536318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cef848-94a8-412e-a398-73ea87e84939 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:51.536750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cef848-94a8-412e-a398-73ea87e84939 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:51.536896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cef848-94a8-412e-a398-73ea87e84939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:51.606174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-64cef848-94a8-412e-a398-73ea87e84939 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:51.607384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-64cef848-94a8-412e-a398-73ea87e84939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:51.706331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 535/1061] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:51.999787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a7b62-5724-41e7-b748-3123028993d4 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:52.001306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d87a7b62-5724-41e7-b748-3123028993d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:52.160018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a7b62-5724-41e7-b748-3123028993d4 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:52.228871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:52.283256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7504b-2bf4-4c9d-aea0-d56fbcdc3f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:52.283866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7504b-2bf4-4c9d-aea0-d56fbcdc3f59 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:52.284181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7504b-2bf4-4c9d-aea0-d56fbcdc3f59 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:52.284411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7504b-2bf4-4c9d-aea0-d56fbcdc3f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:52.286016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2fe7504b-2bf4-4c9d-aea0-d56fbcdc3f59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:52.377006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7504b-2bf4-4c9d-aea0-d56fbcdc3f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:52.378594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7504b-2bf4-4c9d-aea0-d56fbcdc3f59 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:52.397051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 527/1062] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:54.903715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811b8d-5a80-484f-9928-19dcea3f460a None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:54.904256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811b8d-5a80-484f-9928-19dcea3f460a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:54.904256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811b8d-5a80-484f-9928-19dcea3f460a None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:54.905624 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 536/1063] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:54.910793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63ce79-871c-4932-be25-6389b7b36059 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:54.911215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63ce79-871c-4932-be25-6389b7b36059 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:54.911401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63ce79-871c-4932-be25-6389b7b36059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:54.978596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ee63ce79-871c-4932-be25-6389b7b36059 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:54.979831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ee63ce79-871c-4932-be25-6389b7b36059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:55.013801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:55.077810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 528/1064] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:55.368007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93811b8d-5a80-484f-9928-19dcea3f460a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:55.369516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-93811b8d-5a80-484f-9928-19dcea3f460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:55.444656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:55.516438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93811b8d-5a80-484f-9928-19dcea3f460a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:55.626891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62b18d-2f83-4100-a14c-87aa46b2af88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:55.627420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b18d-2f83-4100-a14c-87aa46b2af88 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:55.627689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b18d-2f83-4100-a14c-87aa46b2af88 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:55.627954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b18d-2f83-4100-a14c-87aa46b2af88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:55.629537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5e62b18d-2f83-4100-a14c-87aa46b2af88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:55.668468 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:55.722099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62b18d-2f83-4100-a14c-87aa46b2af88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:55.723687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62b18d-2f83-4100-a14c-87aa46b2af88 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:55.741396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 537/1065] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:56.078025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733420a-c416-4c91-914b-ea6b8b68b83d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:56.078554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733420a-c416-4c91-914b-ea6b8b68b83d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:56.078554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733420a-c416-4c91-914b-ea6b8b68b83d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:56.079951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 529/1066] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:56.085260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916f14-4cac-4eb2-8e77-adb44b7eedc7 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:56.085735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916f14-4cac-4eb2-8e77-adb44b7eedc7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:56.085901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d916f14-4cac-4eb2-8e77-adb44b7eedc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:56.152986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8d916f14-4cac-4eb2-8e77-adb44b7eedc7 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:56.154228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8d916f14-4cac-4eb2-8e77-adb44b7eedc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:56.250953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 538/1067] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:56.559432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7d8a-64a6-4898-b75d-03ac3fa9b09d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:56.559749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7d8a-64a6-4898-b75d-03ac3fa9b09d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:56.560026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7d8a-64a6-4898-b75d-03ac3fa9b09d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:56.561374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 530/1068] 10.222.0.47 () {54 vars in 962 bytes} [Fri Oct 14 12:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:56.566584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e3ba-ca27-426d-b817-5ac7958d62c2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:56.566866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e3ba-ca27-426d-b817-5ac7958d62c2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:56.567138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e3ba-ca27-426d-b817-5ac7958d62c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:56.583038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:56.647834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d5a5e3ba-ca27-426d-b817-5ac7958d62c2 None None] MFA Rules not processed for user `3697284166c042d79d946ef469932562`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:56.649754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d5a5e3ba-ca27-426d-b817-5ac7958d62c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:56.726876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 539/1069] 10.222.0.47 () {58 vars in 1059 bytes} [Fri Oct 14 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:56.736334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd7d8a-64a6-4898-b75d-03ac3fa9b09d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:56.737879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-11dd7d8a-64a6-4898-b75d-03ac3fa9b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:56.844627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd7d8a-64a6-4898-b75d-03ac3fa9b09d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:56.911268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:56.928367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0260ad-10d6-4a7f-ab8b-e14150ad6782 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3697284166c042d79d946ef469932562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:56.928967 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0260ad-10d6-4a7f-ab8b-e14150ad6782 service glance] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:56.929242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0260ad-10d6-4a7f-ab8b-e14150ad6782 service glance] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:56.929596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0260ad-10d6-4a7f-ab8b-e14150ad6782 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:56.931186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bc0260ad-10d6-4a7f-ab8b-e14150ad6782 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:57.050439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0260ad-10d6-4a7f-ab8b-e14150ad6782 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:57.051865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0260ad-10d6-4a7f-ab8b-e14150ad6782 service glance] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:57.069394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 531/1070] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:57.819533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a53ad2-9e46-4108-ab48-cec54c7f157b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:57.820010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a53ad2-9e46-4108-ab48-cec54c7f157b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:57.820174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a53ad2-9e46-4108-ab48-cec54c7f157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:57.892324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e0a53ad2-9e46-4108-ab48-cec54c7f157b None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:57.893564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e0a53ad2-9e46-4108-ab48-cec54c7f157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:57.949452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:57.956280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46f46-1eed-42cb-a595-6f5e9c762181 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:57.956914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46f46-1eed-42cb-a595-6f5e9c762181 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:57.956914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef46f46-1eed-42cb-a595-6f5e9c762181 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:57.958176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 532/1071] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:57.963420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b807-e883-4391-9a17-c4524bade332 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:57.963697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b807-e883-4391-9a17-c4524bade332 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:57.963969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b807-e883-4391-9a17-c4524bade332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:57.984342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 540/1072] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 12:52:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:58.027761 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da309-f1e6-47af-b3a3-560b9be4634c None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:58.028037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da309-f1e6-47af-b3a3-560b9be4634c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:58.028306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da309-f1e6-47af-b3a3-560b9be4634c None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:58.029807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 541/1073] 10.222.0.47 () {54 vars in 943 bytes} [Fri Oct 14 12:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:52:58.036082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4dc6-268b-456b-a363-b56cb5d28005 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:58.036427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4dc6-268b-456b-a363-b56cb5d28005 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:58.036781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4dc6-268b-456b-a363-b56cb5d28005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:58.038493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0280b807-e883-4391-9a17-c4524bade332 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:58.040247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0280b807-e883-4391-9a17-c4524bade332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:58.082865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:58.122638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-499d4dc6-268b-456b-a363-b56cb5d28005 None None] MFA Rules not processed for user `6d66e92ebdd94630b887b31470be78ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:58.123901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-499d4dc6-268b-456b-a363-b56cb5d28005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:58.151962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 533/1074] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:52:58.240171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 542/1075] 10.222.0.47 () {58 vars in 1040 bytes} [Fri Oct 14 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:52:58.250801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b807-e883-4391-9a17-c4524bade332 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:58.252115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0280b807-e883-4391-9a17-c4524bade332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:58.367523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b807-e883-4391-9a17-c4524bade332 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:58.433518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:58.442644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d4dc6-268b-456b-a363-b56cb5d28005 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:58.443830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-499d4dc6-268b-456b-a363-b56cb5d28005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:58.475234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5b476-fca1-4613-bb3c-fca43ada2c41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:58.475854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5b476-fca1-4613-bb3c-fca43ada2c41 service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:58.476009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:58.476112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5b476-fca1-4613-bb3c-fca43ada2c41 service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:58.477120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5b476-fca1-4613-bb3c-fca43ada2c41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:58.478716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-eab5b476-fca1-4613-bb3c-fca43ada2c41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:58.544610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d4dc6-268b-456b-a363-b56cb5d28005 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:58.564165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5b476-fca1-4613-bb3c-fca43ada2c41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:58.565932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5b476-fca1-4613-bb3c-fca43ada2c41 service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:58.574598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 534/1076] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 12:52:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 12:52:58.669514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae9f0c-ec45-43ac-96a2-7f1ca97d5a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:58.669514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae9f0c-ec45-43ac-96a2-7f1ca97d5a9f service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:58.669514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae9f0c-ec45-43ac-96a2-7f1ca97d5a9f service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:58.669514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae9f0c-ec45-43ac-96a2-7f1ca97d5a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:58.671215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3eae9f0c-ec45-43ac-96a2-7f1ca97d5a9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:58.721434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:58.775283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae9f0c-ec45-43ac-96a2-7f1ca97d5a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:58.776899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae9f0c-ec45-43ac-96a2-7f1ca97d5a9f service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:58.797299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 543/1077] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:01.012330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88098e-b4dd-493d-85ed-604324f40ba7 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:01.012869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88098e-b4dd-493d-85ed-604324f40ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:01.012869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88098e-b4dd-493d-85ed-604324f40ba7 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:01.015390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 535/1078] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:01.019632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5fbcf-6154-4d8a-afc1-0353b1d3f49c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:01.020111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5fbcf-6154-4d8a-afc1-0353b1d3f49c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:01.020234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5fbcf-6154-4d8a-afc1-0353b1d3f49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:01.092619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-41d5fbcf-6154-4d8a-afc1-0353b1d3f49c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:01.094035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-41d5fbcf-6154-4d8a-afc1-0353b1d3f49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:01.204773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 544/1079] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:01.500415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88098e-b4dd-493d-85ed-604324f40ba7 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:01.501981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9c88098e-b4dd-493d-85ed-604324f40ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:01.613723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:01.666528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88098e-b4dd-493d-85ed-604324f40ba7 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:01.799675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1f2ec-b3eb-43bd-9fb5-416be1664c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:01.800194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f2ec-b3eb-43bd-9fb5-416be1664c66 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:01.800467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f2ec-b3eb-43bd-9fb5-416be1664c66 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:01.800757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1f2ec-b3eb-43bd-9fb5-416be1664c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:01.802917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6ef1f2ec-b3eb-43bd-9fb5-416be1664c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:01.872515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:01.904512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1f2ec-b3eb-43bd-9fb5-416be1664c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:01.906534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1f2ec-b3eb-43bd-9fb5-416be1664c66 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:01.927514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 536/1080] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:04.174058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6d2d-e2a8-4de8-9369-ec9d29e90690 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:04.174662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6d2d-e2a8-4de8-9369-ec9d29e90690 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:04.174662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6d2d-e2a8-4de8-9369-ec9d29e90690 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:04.175915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 545/1081] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:04.181371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6875b-8ce2-47ff-864d-8cd749a338d1 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:04.182233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6875b-8ce2-47ff-864d-8cd749a338d1 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:04.182702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6875b-8ce2-47ff-864d-8cd749a338d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:04.255380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-65f6875b-8ce2-47ff-864d-8cd749a338d1 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:04.256602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-65f6875b-8ce2-47ff-864d-8cd749a338d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:04.369120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 537/1082] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:04.661507 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e6d2d-e2a8-4de8-9369-ec9d29e90690 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:04.663032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f17e6d2d-e2a8-4de8-9369-ec9d29e90690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:04.684936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:04.827707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e6d2d-e2a8-4de8-9369-ec9d29e90690 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:04.935926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:04.961170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d40dff-0811-4aa4-83cd-a5fea397cf98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:04.961814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40dff-0811-4aa4-83cd-a5fea397cf98 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:04.962112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40dff-0811-4aa4-83cd-a5fea397cf98 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:04.962366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d40dff-0811-4aa4-83cd-a5fea397cf98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:04.963964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-56d40dff-0811-4aa4-83cd-a5fea397cf98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:05.081266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d40dff-0811-4aa4-83cd-a5fea397cf98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:05.082919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d40dff-0811-4aa4-83cd-a5fea397cf98 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:05.103162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 546/1083] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:07.347930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064b3eb-ad23-44c8-8633-afb0db00e57e None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:07.348471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064b3eb-ad23-44c8-8633-afb0db00e57e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:07.348471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064b3eb-ad23-44c8-8633-afb0db00e57e None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:07.353508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 538/1084] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:07.355691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f700e0c-14d9-4d70-9f2b-564402447f9b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:07.356110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f700e0c-14d9-4d70-9f2b-564402447f9b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:07.356217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f700e0c-14d9-4d70-9f2b-564402447f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:07.431204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6f700e0c-14d9-4d70-9f2b-564402447f9b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:07.432429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6f700e0c-14d9-4d70-9f2b-564402447f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:07.489093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:07.535966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 547/1085] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:07.837249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064b3eb-ad23-44c8-8633-afb0db00e57e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:07.839154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e064b3eb-ad23-44c8-8633-afb0db00e57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:07.895190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:08.010319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064b3eb-ad23-44c8-8633-afb0db00e57e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:08.136927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f8250-32c7-42ba-89d1-8ce8760a60e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:08.137935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8250-32c7-42ba-89d1-8ce8760a60e3 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:08.138210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8250-32c7-42ba-89d1-8ce8760a60e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:08.138481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f8250-32c7-42ba-89d1-8ce8760a60e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:08.140075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c82f8250-32c7-42ba-89d1-8ce8760a60e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:08.142550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:08.243560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f8250-32c7-42ba-89d1-8ce8760a60e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:08.245223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f8250-32c7-42ba-89d1-8ce8760a60e3 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:08.263373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 539/1086] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:17.534360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=19 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:18.261157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=44 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:21.166163 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b0e-bf9c-43ff-89a2-01a7c1808730 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:21.166726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b0e-bf9c-43ff-89a2-01a7c1808730 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:21.166726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b0e-bf9c-43ff-89a2-01a7c1808730 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:21.168038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 548/1087] 10.222.0.47 () {54 vars in 918 bytes} [Fri Oct 14 12:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:53:21.173276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c49e1-11b3-45b6-9cdb-b08e4efcf356 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:21.173755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c49e1-11b3-45b6-9cdb-b08e4efcf356 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:21.173866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c49e1-11b3-45b6-9cdb-b08e4efcf356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:21.249862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b82c49e1-11b3-45b6-9cdb-b08e4efcf356 None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:21.251049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b82c49e1-11b3-45b6-9cdb-b08e4efcf356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:21.353473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 540/1088] 10.222.0.47 () {58 vars in 1015 bytes} [Fri Oct 14 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:21.367927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ad3e-eb07-4d3a-bc1b-b5b3ec7ffc9d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:21.368213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ad3e-eb07-4d3a-bc1b-b5b3ec7ffc9d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:21.368486 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ad3e-eb07-4d3a-bc1b-b5b3ec7ffc9d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:21.369910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 549/1089] 10.222.0.47 () {54 vars in 918 bytes} [Fri Oct 14 12:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:21.374729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fc529-5389-464e-bae5-b96996ea2910 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:21.375012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fc529-5389-464e-bae5-b96996ea2910 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:21.375305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fc529-5389-464e-bae5-b96996ea2910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:21.447033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:21.449787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-be2fc529-5389-464e-bae5-b96996ea2910 None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:21.451629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-be2fc529-5389-464e-bae5-b96996ea2910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:21.564910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 541/1090] 10.222.0.47 () {58 vars in 1015 bytes} [Fri Oct 14 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:53:24.119237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593dda-4197-478b-8fbc-c721e2288753 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:24.119783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593dda-4197-478b-8fbc-c721e2288753 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:24.119783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593dda-4197-478b-8fbc-c721e2288753 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:24.121164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 550/1091] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:24.126657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93e65-34a9-458f-ad9f-fda1b8d2866c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:24.127068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93e65-34a9-458f-ad9f-fda1b8d2866c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:24.127198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93e65-34a9-458f-ad9f-fda1b8d2866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:24.192403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d7e93e65-34a9-458f-ad9f-fda1b8d2866c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:24.193616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d7e93e65-34a9-458f-ad9f-fda1b8d2866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:24.250630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:24.291236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 542/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:24.577014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593dda-4197-478b-8fbc-c721e2288753 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:24.578606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fa593dda-4197-478b-8fbc-c721e2288753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:24.721450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593dda-4197-478b-8fbc-c721e2288753 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:24.793452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:24.831975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd872c-9707-4a47-bc41-58b68eff6ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:24.832509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd872c-9707-4a47-bc41-58b68eff6ae0 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:24.832783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd872c-9707-4a47-bc41-58b68eff6ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:24.833047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd872c-9707-4a47-bc41-58b68eff6ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:24.834636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-36cd872c-9707-4a47-bc41-58b68eff6ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:24.925673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd872c-9707-4a47-bc41-58b68eff6ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:24.927260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd872c-9707-4a47-bc41-58b68eff6ae0 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:24.945019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 551/1093] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:26.074015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8be65-04ed-437f-818c-e65374381923 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:26.074542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8be65-04ed-437f-818c-e65374381923 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:26.074542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8be65-04ed-437f-818c-e65374381923 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:26.075866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 543/1094] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:26.081938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad8e8-e6a4-4ac9-b712-8e3e5a6774a0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:26.082392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad8e8-e6a4-4ac9-b712-8e3e5a6774a0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:26.082499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad8e8-e6a4-4ac9-b712-8e3e5a6774a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:26.157196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-536ad8e8-e6a4-4ac9-b712-8e3e5a6774a0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:26.158427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-536ad8e8-e6a4-4ac9-b712-8e3e5a6774a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:26.185086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:26.254235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 552/1095] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:26.401912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8be65-04ed-437f-818c-e65374381923 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:26.403398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-91a8be65-04ed-437f-818c-e65374381923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:26.545438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8be65-04ed-437f-818c-e65374381923 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:26.585114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:26.657630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e921698-9c93-4328-8d75-21b7f799455e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:26.658223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921698-9c93-4328-8d75-21b7f799455e service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:26.658497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921698-9c93-4328-8d75-21b7f799455e service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:26.658759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921698-9c93-4328-8d75-21b7f799455e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:26.660333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6e921698-9c93-4328-8d75-21b7f799455e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:26.746849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e921698-9c93-4328-8d75-21b7f799455e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:26.748411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e921698-9c93-4328-8d75-21b7f799455e service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:26.766425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 544/1096] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:27.887790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719809-2ca8-4d99-ade8-0c5e4221231d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:27.888365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719809-2ca8-4d99-ade8-0c5e4221231d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:27.888365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e719809-2ca8-4d99-ade8-0c5e4221231d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:27.889698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 553/1097] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:27.895848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c1af-a742-45e2-ae22-ee8103d43b8e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:27.896301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c1af-a742-45e2-ae22-ee8103d43b8e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:27.896424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c1af-a742-45e2-ae22-ee8103d43b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:27.950306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:27.972072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-e777c1af-a742-45e2-ae22-ee8103d43b8e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:27.973275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e777c1af-a742-45e2-ae22-ee8103d43b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:28.071412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 545/1098] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:28.222960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e719809-2ca8-4d99-ade8-0c5e4221231d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:28.224424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4e719809-2ca8-4d99-ade8-0c5e4221231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:28.367472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e719809-2ca8-4d99-ade8-0c5e4221231d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:28.379212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:28.479441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e37b25-6829-4e09-8601-620e690487ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:28.479959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37b25-6829-4e09-8601-620e690487ec service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:28.480240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37b25-6829-4e09-8601-620e690487ec service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:28.480511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e37b25-6829-4e09-8601-620e690487ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:28.482122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-38e37b25-6829-4e09-8601-620e690487ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:28.570806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e37b25-6829-4e09-8601-620e690487ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:28.572399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e37b25-6829-4e09-8601-620e690487ec service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:28.590367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 554/1099] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:29.686216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e71dbf-717d-4148-8581-5e8b8ead4944 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:29.686771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e71dbf-717d-4148-8581-5e8b8ead4944 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:29.686771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e71dbf-717d-4148-8581-5e8b8ead4944 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:29.688102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 546/1100] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:29.694804 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26856bf5-dbf7-4012-b192-71b79c9c8713 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:29.695375 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26856bf5-dbf7-4012-b192-71b79c9c8713 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:29.695375 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26856bf5-dbf7-4012-b192-71b79c9c8713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:29.715647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:29.771166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-26856bf5-dbf7-4012-b192-71b79c9c8713 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:29.772948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-26856bf5-dbf7-4012-b192-71b79c9c8713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:29.867210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 555/1101] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:30.016528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e71dbf-717d-4148-8581-5e8b8ead4944 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:30.018057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e5e71dbf-717d-4148-8581-5e8b8ead4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:30.125049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:30.160284 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e71dbf-717d-4148-8581-5e8b8ead4944 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:30.271599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca861da-e619-40c5-bf95-598b2ec22adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:30.272119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca861da-e619-40c5-bf95-598b2ec22adf service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:30.272389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca861da-e619-40c5-bf95-598b2ec22adf service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:30.272655 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca861da-e619-40c5-bf95-598b2ec22adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:30.274257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7ca861da-e619-40c5-bf95-598b2ec22adf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:30.348659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:30.362757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca861da-e619-40c5-bf95-598b2ec22adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:30.364471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca861da-e619-40c5-bf95-598b2ec22adf service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:30.382504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 547/1102] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:31.489695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914051e-76d7-4f42-83c8-fe5f9d503797 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:31.490296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914051e-76d7-4f42-83c8-fe5f9d503797 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:31.490296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914051e-76d7-4f42-83c8-fe5f9d503797 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:31.492109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 556/1103] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:31.498239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e8c5-ccc0-40e7-8c07-df46c0d088c3 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:31.498669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e8c5-ccc0-40e7-8c07-df46c0d088c3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:31.498777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e8c5-ccc0-40e7-8c07-df46c0d088c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:31.573610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8560e8c5-ccc0-40e7-8c07-df46c0d088c3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:31.574802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8560e8c5-ccc0-40e7-8c07-df46c0d088c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:31.668985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 548/1104] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:31.818432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914051e-76d7-4f42-83c8-fe5f9d503797 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:31.820396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3914051e-76d7-4f42-83c8-fe5f9d503797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:31.903596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:31.964791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914051e-76d7-4f42-83c8-fe5f9d503797 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:32.081961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a966457-61ed-4d0d-bcf5-b34446d93ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:32.082492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a966457-61ed-4d0d-bcf5-b34446d93ccd service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:32.082766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a966457-61ed-4d0d-bcf5-b34446d93ccd service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:32.083033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a966457-61ed-4d0d-bcf5-b34446d93ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:32.084660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5a966457-61ed-4d0d-bcf5-b34446d93ccd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:32.133097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:32.174211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a966457-61ed-4d0d-bcf5-b34446d93ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:32.175795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a966457-61ed-4d0d-bcf5-b34446d93ccd service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:32.193986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 557/1105] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:33.254427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e43a-9c80-4881-a689-6b6c1b1e2663 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:33.255016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e43a-9c80-4881-a689-6b6c1b1e2663 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:33.255016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e43a-9c80-4881-a689-6b6c1b1e2663 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:33.256798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 549/1106] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:33.263083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ceeb8-eabd-4861-b4cf-27127fe8e445 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:33.263533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ceeb8-eabd-4861-b4cf-27127fe8e445 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:33.263634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ceeb8-eabd-4861-b4cf-27127fe8e445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:33.338200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3c7ceeb8-eabd-4861-b4cf-27127fe8e445 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:33.339384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3c7ceeb8-eabd-4861-b4cf-27127fe8e445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:33.437153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 558/1107] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:33.586933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e43a-9c80-4881-a689-6b6c1b1e2663 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:33.588437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-fd17e43a-9c80-4881-a689-6b6c1b1e2663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:33.636687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:33.731580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e43a-9c80-4881-a689-6b6c1b1e2663 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:33.841018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b27280-6aa4-4190-9444-f4e5dde8e542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:33.841644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b27280-6aa4-4190-9444-f4e5dde8e542 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:33.841916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b27280-6aa4-4190-9444-f4e5dde8e542 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:33.842183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b27280-6aa4-4190-9444-f4e5dde8e542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:33.843751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-69b27280-6aa4-4190-9444-f4e5dde8e542 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:33.851046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:33.931701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b27280-6aa4-4190-9444-f4e5dde8e542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:33.933318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b27280-6aa4-4190-9444-f4e5dde8e542 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:33.951200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 550/1108] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:34.999003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd35fd-e81d-4a4f-becc-c7f16f90ad4f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:34.999430 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd35fd-e81d-4a4f-becc-c7f16f90ad4f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:34.999552 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd35fd-e81d-4a4f-becc-c7f16f90ad4f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:35.000891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 559/1109] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:35.007043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1730-32df-478a-afc6-c78f16411a53 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:35.007473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1730-32df-478a-afc6-c78f16411a53 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:35.007573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1730-32df-478a-afc6-c78f16411a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:35.083872 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-edcc1730-32df-478a-afc6-c78f16411a53 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:35.085604 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-edcc1730-32df-478a-afc6-c78f16411a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:35.156674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:35.186034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 551/1110] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:35.336011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd35fd-e81d-4a4f-becc-c7f16f90ad4f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:35.337455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-94cd35fd-e81d-4a4f-becc-c7f16f90ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:35.355419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:35.481291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd35fd-e81d-4a4f-becc-c7f16f90ad4f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:35.566504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:35.593343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508b941-2f4d-4239-a26e-49991f332cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:35.593977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b941-2f4d-4239-a26e-49991f332cb5 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:35.594250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b941-2f4d-4239-a26e-49991f332cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:35.594516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508b941-2f4d-4239-a26e-49991f332cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:35.596098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1508b941-2f4d-4239-a26e-49991f332cb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:35.683342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508b941-2f4d-4239-a26e-49991f332cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:35.684934 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508b941-2f4d-4239-a26e-49991f332cb5 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:35.703114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 560/1111] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:53:36.744459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a98a0-0eee-40f9-be86-8f23ab36bd4f None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:36.745012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a98a0-0eee-40f9-be86-8f23ab36bd4f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:36.745012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a98a0-0eee-40f9-be86-8f23ab36bd4f None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:36.746361 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 552/1112] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:36.752610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634cb45-3835-4d24-a2cc-eb78e6e0d898 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:36.753061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634cb45-3835-4d24-a2cc-eb78e6e0d898 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:36.753166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634cb45-3835-4d24-a2cc-eb78e6e0d898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:36.827675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6634cb45-3835-4d24-a2cc-eb78e6e0d898 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:36.828859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6634cb45-3835-4d24-a2cc-eb78e6e0d898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:36.869028 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:36.923890 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 561/1113] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:53:37.072057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a98a0-0eee-40f9-be86-8f23ab36bd4f None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:37.073502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5e2a98a0-0eee-40f9-be86-8f23ab36bd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:37.216724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a98a0-0eee-40f9-be86-8f23ab36bd4f None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:37.270818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:37.329405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43035455-0897-44f9-813c-9498ec09c3eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:37.329967 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035455-0897-44f9-813c-9498ec09c3eb service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:37.330244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035455-0897-44f9-813c-9498ec09c3eb service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:37.330514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43035455-0897-44f9-813c-9498ec09c3eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:37.332098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-43035455-0897-44f9-813c-9498ec09c3eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:37.421122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43035455-0897-44f9-813c-9498ec09c3eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:37.422733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43035455-0897-44f9-813c-9498ec09c3eb service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:37.440488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 553/1114] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:38.489535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323306d0-14ff-4c4f-87ed-e53249dbf0a6 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:38.490051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323306d0-14ff-4c4f-87ed-e53249dbf0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:38.490151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323306d0-14ff-4c4f-87ed-e53249dbf0a6 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:38.491472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 562/1115] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:38.497680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe856-ba17-4b85-9e8d-c9c79eaa584e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:38.498141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe856-ba17-4b85-9e8d-c9c79eaa584e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:38.498251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe856-ba17-4b85-9e8d-c9c79eaa584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:38.575348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b9abe856-ba17-4b85-9e8d-c9c79eaa584e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:38.576554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b9abe856-ba17-4b85-9e8d-c9c79eaa584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:38.578611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:38.673362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 554/1116] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:38.823999 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323306d0-14ff-4c4f-87ed-e53249dbf0a6 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:38.825499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-323306d0-14ff-4c4f-87ed-e53249dbf0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:38.969460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323306d0-14ff-4c4f-87ed-e53249dbf0a6 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:38.998685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:39.082968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cb337-751c-4112-89b6-a3b2a5b764cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:39.083499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb337-751c-4112-89b6-a3b2a5b764cd service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:39.083776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb337-751c-4112-89b6-a3b2a5b764cd service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:39.084047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb337-751c-4112-89b6-a3b2a5b764cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:39.086147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d74cb337-751c-4112-89b6-a3b2a5b764cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:39.173458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cb337-751c-4112-89b6-a3b2a5b764cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:39.175084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cb337-751c-4112-89b6-a3b2a5b764cd service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:39.193640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 563/1117] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:41.229236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44209b-7531-404b-9499-50aca4c40312 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:41.229850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44209b-7531-404b-9499-50aca4c40312 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:41.229850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44209b-7531-404b-9499-50aca4c40312 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:41.231123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 555/1118] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:41.236533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac96c18-1103-4470-b6cf-e86ad5d3c5d1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:41.236944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac96c18-1103-4470-b6cf-e86ad5d3c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:41.237052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac96c18-1103-4470-b6cf-e86ad5d3c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:41.277191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:41.302898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bac96c18-1103-4470-b6cf-e86ad5d3c5d1 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:41.304103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bac96c18-1103-4470-b6cf-e86ad5d3c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:41.399340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 564/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:41.684764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44209b-7531-404b-9499-50aca4c40312 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:41.686328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-da44209b-7531-404b-9499-50aca4c40312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:41.788276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44209b-7531-404b-9499-50aca4c40312 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:41.820042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:41.860617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d6b78-4405-4683-9134-d06c3c334335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:41.861209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d6b78-4405-4683-9134-d06c3c334335 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:41.861496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d6b78-4405-4683-9134-d06c3c334335 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:41.861773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d6b78-4405-4683-9134-d06c3c334335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:41.863343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ef8d6b78-4405-4683-9134-d06c3c334335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:41.968610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d6b78-4405-4683-9134-d06c3c334335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:41.969995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d6b78-4405-4683-9134-d06c3c334335 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:41.991143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 556/1120] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:53:44.261902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f095-5d6c-4361-8cd5-db3a2a9057e0 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:44.262402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f095-5d6c-4361-8cd5-db3a2a9057e0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:44.262402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f095-5d6c-4361-8cd5-db3a2a9057e0 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:44.263694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 565/1121] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:44.268820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d83ef-db4a-4eb5-ba18-51c1fd052acb None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:44.269242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d83ef-db4a-4eb5-ba18-51c1fd052acb None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:44.269385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d83ef-db4a-4eb5-ba18-51c1fd052acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:44.334568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-6f1d83ef-db4a-4eb5-ba18-51c1fd052acb None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:44.335754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6f1d83ef-db4a-4eb5-ba18-51c1fd052acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:44.348346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:44.431055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 557/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:44.715132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f095-5d6c-4361-8cd5-db3a2a9057e0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:44.716635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1652f095-5d6c-4361-8cd5-db3a2a9057e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:44.818816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f095-5d6c-4361-8cd5-db3a2a9057e0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:44.831342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:44.892832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54026-5f6e-4ee9-b000-6009e60026f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:44.893426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54026-5f6e-4ee9-b000-6009e60026f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:44.893724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54026-5f6e-4ee9-b000-6009e60026f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:44.893989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54026-5f6e-4ee9-b000-6009e60026f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:44.895539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-56e54026-5f6e-4ee9-b000-6009e60026f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:45.002064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54026-5f6e-4ee9-b000-6009e60026f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:45.003539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54026-5f6e-4ee9-b000-6009e60026f9 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:45.021416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 566/1123] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:47.445957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e48e0-7d0b-4c68-8750-4d63848e6aae None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:47.446511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e48e0-7d0b-4c68-8750-4d63848e6aae None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:47.446511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e48e0-7d0b-4c68-8750-4d63848e6aae None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:47.447737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 558/1124] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:47.452976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d09bc-3abc-49b1-a294-acfb704d5087 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:47.453387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d09bc-3abc-49b1-a294-acfb704d5087 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:47.453535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d09bc-3abc-49b1-a294-acfb704d5087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:47.501204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:47.519067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d76d09bc-3abc-49b1-a294-acfb704d5087 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:47.520343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d76d09bc-3abc-49b1-a294-acfb704d5087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:47.615932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 567/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:47.899844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e48e0-7d0b-4c68-8750-4d63848e6aae None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:47.901355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-726e48e0-7d0b-4c68-8750-4d63848e6aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:48.002861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e48e0-7d0b-4c68-8750-4d63848e6aae None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:48.042304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:48.075853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b6522-b43b-4a9d-9f27-9b5af5742a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:48.076451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b6522-b43b-4a9d-9f27-9b5af5742a5a service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:48.076725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b6522-b43b-4a9d-9f27-9b5af5742a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:48.076990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b6522-b43b-4a9d-9f27-9b5af5742a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:48.078609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-958b6522-b43b-4a9d-9f27-9b5af5742a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:48.185610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b6522-b43b-4a9d-9f27-9b5af5742a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:48.186964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b6522-b43b-4a9d-9f27-9b5af5742a5a service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:48.205054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 559/1126] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:50.467148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6197-354e-484b-8bcd-e0a06d77bb8f None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:50.467683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6197-354e-484b-8bcd-e0a06d77bb8f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:50.467814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d6197-354e-484b-8bcd-e0a06d77bb8f None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:50.469391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 568/1127] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:50.475801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500abe-6310-4aba-9535-d09b478e81f0 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:50.476275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500abe-6310-4aba-9535-d09b478e81f0 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:50.476423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c500abe-6310-4aba-9535-d09b478e81f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:50.543682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-6c500abe-6310-4aba-9535-d09b478e81f0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:50.544879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6c500abe-6310-4aba-9535-d09b478e81f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:50.565685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:50.641605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 560/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:50.927186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6197-354e-484b-8bcd-e0a06d77bb8f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:50.928768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-348d6197-354e-484b-8bcd-e0a06d77bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:51.031998 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d6197-354e-484b-8bcd-e0a06d77bb8f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:51.052806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:51.107077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31b856-9fdf-4d9f-9343-627adf28b2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:51.107680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b856-9fdf-4d9f-9343-627adf28b2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:51.107951 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b856-9fdf-4d9f-9343-627adf28b2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:51.108463 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b856-9fdf-4d9f-9343-627adf28b2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:51.110077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2b31b856-9fdf-4d9f-9343-627adf28b2d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:51.220629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31b856-9fdf-4d9f-9343-627adf28b2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:51.222113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31b856-9fdf-4d9f-9343-627adf28b2d7 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:51.240061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 569/1129] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:53.702455 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c88ce-1d7d-4a0f-9634-daea50190ca9 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:53.703002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c88ce-1d7d-4a0f-9634-daea50190ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:53.703002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c88ce-1d7d-4a0f-9634-daea50190ca9 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:53.704268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 561/1130] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:53.710931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ffee-4f5b-4c44-a3b3-4eaed6af0162 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:53.711351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ffee-4f5b-4c44-a3b3-4eaed6af0162 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:53.711470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ffee-4f5b-4c44-a3b3-4eaed6af0162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:53.777137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:53.780556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8f88ffee-4f5b-4c44-a3b3-4eaed6af0162 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:53.782325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8f88ffee-4f5b-4c44-a3b3-4eaed6af0162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:53.894434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 570/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:54.207809 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c88ce-1d7d-4a0f-9634-daea50190ca9 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:54.209720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2e7c88ce-1d7d-4a0f-9634-daea50190ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:54.330234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c88ce-1d7d-4a0f-9634-daea50190ca9 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:54.384441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:54.409051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eba1d-2566-4c9c-874e-5d0c6ff4db6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:54.409677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eba1d-2566-4c9c-874e-5d0c6ff4db6e service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:54.409958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eba1d-2566-4c9c-874e-5d0c6ff4db6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:54.410224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eba1d-2566-4c9c-874e-5d0c6ff4db6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:54.412331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-944eba1d-2566-4c9c-874e-5d0c6ff4db6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:54.522247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eba1d-2566-4c9c-874e-5d0c6ff4db6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:54.523676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eba1d-2566-4c9c-874e-5d0c6ff4db6e service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:54.541849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 562/1132] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:56.856142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ca55-b8c4-4aca-8669-d449886fe935 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:56.856623 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ca55-b8c4-4aca-8669-d449886fe935 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:56.856744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936ca55-b8c4-4aca-8669-d449886fe935 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:56.858105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 571/1133] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:56.863720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313c2ac-6097-433f-afd4-006f12839616 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:56.864138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313c2ac-6097-433f-afd4-006f12839616 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:56.864249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313c2ac-6097-433f-afd4-006f12839616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:56.929852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b313c2ac-6097-433f-afd4-006f12839616 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:56.931083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b313c2ac-6097-433f-afd4-006f12839616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:56.959787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:57.028323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 563/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:57.313056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936ca55-b8c4-4aca-8669-d449886fe935 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:57.314634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1936ca55-b8c4-4aca-8669-d449886fe935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:57.417254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936ca55-b8c4-4aca-8669-d449886fe935 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:57.446086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:57.491683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5a7f9-2af2-4c8f-bc4d-c1e3df99e83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:57.492291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5a7f9-2af2-4c8f-bc4d-c1e3df99e83e service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:57.492567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5a7f9-2af2-4c8f-bc4d-c1e3df99e83e service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:57.492835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5a7f9-2af2-4c8f-bc4d-c1e3df99e83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:57.494448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b9a5a7f9-2af2-4c8f-bc4d-c1e3df99e83e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:57.603330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5a7f9-2af2-4c8f-bc4d-c1e3df99e83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:57.604768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5a7f9-2af2-4c8f-bc4d-c1e3df99e83e service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:57.623872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 572/1135] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:59.818668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795016-9586-46ca-bf02-921ac6d4e505 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:59.819231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795016-9586-46ca-bf02-921ac6d4e505 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:59.819231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795016-9586-46ca-bf02-921ac6d4e505 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:59.820554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 564/1136] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:59.825912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448da87-be12-4ebd-a873-17586da7e00f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:59.826311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448da87-be12-4ebd-a873-17586da7e00f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:59.826453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448da87-be12-4ebd-a873-17586da7e00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:59.891958 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d448da87-be12-4ebd-a873-17586da7e00f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:59.893150 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d448da87-be12-4ebd-a873-17586da7e00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:59.901433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:59.991790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 573/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:00.270722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de795016-9586-46ca-bf02-921ac6d4e505 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:00.272282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-de795016-9586-46ca-bf02-921ac6d4e505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:00.374279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de795016-9586-46ca-bf02-921ac6d4e505 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:00.428841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:00.446565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee27e4-a118-4264-89a7-1b27f7ee79ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:00.447162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee27e4-a118-4264-89a7-1b27f7ee79ee service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:00.447439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee27e4-a118-4264-89a7-1b27f7ee79ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:00.447705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee27e4-a118-4264-89a7-1b27f7ee79ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:00.449273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bbee27e4-a118-4264-89a7-1b27f7ee79ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:00.555972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee27e4-a118-4264-89a7-1b27f7ee79ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:00.557320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee27e4-a118-4264-89a7-1b27f7ee79ee service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:00.574694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 565/1138] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:02.729362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5a6c-7f8c-47c1-b079-a865559ee4f3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:02.729935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5a6c-7f8c-47c1-b079-a865559ee4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:02.729935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5a6c-7f8c-47c1-b079-a865559ee4f3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:02.731287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 574/1139] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:02.736946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ca526-bb34-4b4f-b479-8cb01ef88954 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:02.737353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ca526-bb34-4b4f-b479-8cb01ef88954 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:02.737462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ca526-bb34-4b4f-b479-8cb01ef88954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:02.802930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b71ca526-bb34-4b4f-b479-8cb01ef88954 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:02.804117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b71ca526-bb34-4b4f-b479-8cb01ef88954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:02.843542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:02.901374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 566/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:03.185579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c5a6c-7f8c-47c1-b079-a865559ee4f3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:03.187094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a17c5a6c-7f8c-47c1-b079-a865559ee4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:03.288735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c5a6c-7f8c-47c1-b079-a865559ee4f3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:03.326008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:03.362217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f9612-6f96-40ff-8fd2-167d21ab6205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:03.362866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9612-6f96-40ff-8fd2-167d21ab6205 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:03.363227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9612-6f96-40ff-8fd2-167d21ab6205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:03.363603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9612-6f96-40ff-8fd2-167d21ab6205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:03.365728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b65f9612-6f96-40ff-8fd2-167d21ab6205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:03.476743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f9612-6f96-40ff-8fd2-167d21ab6205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:03.478217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f9612-6f96-40ff-8fd2-167d21ab6205 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:03.496568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 575/1141] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:05.651584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca199c-ad77-473d-8147-4869e051843d None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:05.652142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca199c-ad77-473d-8147-4869e051843d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:05.652142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca199c-ad77-473d-8147-4869e051843d None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:05.653358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 567/1142] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:05.658978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ce8c-a62b-46cb-9820-0153038bf34c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:05.659657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ce8c-a62b-46cb-9820-0153038bf34c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:05.659657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ce8c-a62b-46cb-9820-0153038bf34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:05.726227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1277ce8c-a62b-46cb-9820-0153038bf34c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:05.727419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1277ce8c-a62b-46cb-9820-0153038bf34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:05.745675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:05.822371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 576/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:06.103560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca199c-ad77-473d-8147-4869e051843d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:06.105168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8eca199c-ad77-473d-8147-4869e051843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:06.209034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca199c-ad77-473d-8147-4869e051843d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:06.275353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:06.282381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef64973-113d-4b63-8c78-17e06c5d47e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:06.282987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef64973-113d-4b63-8c78-17e06c5d47e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:06.283263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef64973-113d-4b63-8c78-17e06c5d47e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:06.283533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef64973-113d-4b63-8c78-17e06c5d47e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:06.285115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3ef64973-113d-4b63-8c78-17e06c5d47e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:06.391628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef64973-113d-4b63-8c78-17e06c5d47e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:06.393047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef64973-113d-4b63-8c78-17e06c5d47e4 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:06.410501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 568/1144] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:08.559491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d54cc-a3ac-44af-969d-065b1d4cefaa None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:08.560059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d54cc-a3ac-44af-969d-065b1d4cefaa None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:08.560059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d54cc-a3ac-44af-969d-065b1d4cefaa None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:08.561368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 577/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:08.566764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e5e6f-c2f4-4d4e-8c44-bd9b2710791d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:08.567190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e5e6f-c2f4-4d4e-8c44-bd9b2710791d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:08.567336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e5e6f-c2f4-4d4e-8c44-bd9b2710791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:08.632964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ac8e5e6f-c2f4-4d4e-8c44-bd9b2710791d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:08.634202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ac8e5e6f-c2f4-4d4e-8c44-bd9b2710791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:08.682637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:08.730114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 569/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:09.012360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d54cc-a3ac-44af-969d-065b1d4cefaa None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:09.013984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-100d54cc-a3ac-44af-969d-065b1d4cefaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:09.115385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d54cc-a3ac-44af-969d-065b1d4cefaa None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:09.162686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:09.188302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84567d5-517e-4b3f-a4a3-027a6c542848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:09.188898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84567d5-517e-4b3f-a4a3-027a6c542848 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:09.189167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84567d5-517e-4b3f-a4a3-027a6c542848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:09.189432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84567d5-517e-4b3f-a4a3-027a6c542848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:09.191009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e84567d5-517e-4b3f-a4a3-027a6c542848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:09.299378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84567d5-517e-4b3f-a4a3-027a6c542848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:09.300751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84567d5-517e-4b3f-a4a3-027a6c542848 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:09.318715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 578/1147] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:18.728635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=22 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:19.316022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=66 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:29.132259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c91e3-e0cb-4b49-89ad-ce0abc712008 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:29.132816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c91e3-e0cb-4b49-89ad-ce0abc712008 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:29.132816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c91e3-e0cb-4b49-89ad-ce0abc712008 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:29.134204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 570/1148] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:29.139490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4785c-3e39-461d-b2b7-cecb3d8b3684 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:29.139937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4785c-3e39-461d-b2b7-cecb3d8b3684 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:29.140042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4785c-3e39-461d-b2b7-cecb3d8b3684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:29.205406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-31d4785c-3e39-461d-b2b7-cecb3d8b3684 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:29.206654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-31d4785c-3e39-461d-b2b7-cecb3d8b3684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:29.318962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 579/1149] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:29.629164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d1c1c-1008-4cdd-904e-882f97b93fae None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:29.629442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d1c1c-1008-4cdd-904e-882f97b93fae None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:29.629794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d1c1c-1008-4cdd-904e-882f97b93fae None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:29.631105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 571/1150] 10.222.0.47 () {54 vars in 962 bytes} [Fri Oct 14 12:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:29.636279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de344-f6a4-446e-9d36-6ac4a5079793 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:29.636562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de344-f6a4-446e-9d36-6ac4a5079793 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:29.636862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de344-f6a4-446e-9d36-6ac4a5079793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:29.712244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0e1de344-f6a4-446e-9d36-6ac4a5079793 None None] MFA Rules not processed for user `3697284166c042d79d946ef469932562`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:29.713456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0e1de344-f6a4-446e-9d36-6ac4a5079793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:29.734473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:29.790120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 580/1151] 10.222.0.47 () {58 vars in 1059 bytes} [Fri Oct 14 12:54:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:29.798102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d1c1c-1008-4cdd-904e-882f97b93fae None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:29.799674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-153d1c1c-1008-4cdd-904e-882f97b93fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:29.902627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d1c1c-1008-4cdd-904e-882f97b93fae None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:29.981470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293c05f-d9ad-4de3-bb68-867b7a1fb410 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3697284166c042d79d946ef469932562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:29.981470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c05f-d9ad-4de3-bb68-867b7a1fb410 service glance] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:29.981470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c05f-d9ad-4de3-bb68-867b7a1fb410 service glance] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:29.981470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c05f-d9ad-4de3-bb68-867b7a1fb410 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:29.982109 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5293c05f-d9ad-4de3-bb68-867b7a1fb410 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:30.036787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:30.091611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293c05f-d9ad-4de3-bb68-867b7a1fb410 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:30.093045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293c05f-d9ad-4de3-bb68-867b7a1fb410 service glance] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:30.112010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 572/1152] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:32.354789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1404c7-8d58-44e8-a80b-1da8a2d38163 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:32.355357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1404c7-8d58-44e8-a80b-1da8a2d38163 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:32.355357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1404c7-8d58-44e8-a80b-1da8a2d38163 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:32.356660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 581/1153] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:32.362366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e19d5-c1a9-45cb-b8a0-31c9abc27cf4 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:32.362797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e19d5-c1a9-45cb-b8a0-31c9abc27cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:32.362908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e19d5-c1a9-45cb-b8a0-31c9abc27cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:32.430297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-196e19d5-c1a9-45cb-b8a0-31c9abc27cf4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:32.431427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-196e19d5-c1a9-45cb-b8a0-31c9abc27cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:32.526960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 573/1154] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:32.802355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1404c7-8d58-44e8-a80b-1da8a2d38163 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:32.803795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0e1404c7-8d58-44e8-a80b-1da8a2d38163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:32.926472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1404c7-8d58-44e8-a80b-1da8a2d38163 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:32.975868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:33.021333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864b53b-7663-4392-af5a-c22012e8bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:33.021993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b53b-7663-4392-af5a-c22012e8bf62 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:33.022266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b53b-7663-4392-af5a-c22012e8bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:33.022529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b53b-7663-4392-af5a-c22012e8bf62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:33.023157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864b53b-7663-4392-af5a-c22012e8bf62 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:33.024248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-a864b53b-7663-4392-af5a-c22012e8bf62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:54:33.024248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:54:33.024248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:54:33.025402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864b53b-7663-4392-af5a-c22012e8bf62 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:33.043907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 582/1155] 10.222.0.47 () {56 vars in 1108 bytes} [Fri Oct 14 12:54:32 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:54:35.188490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261567c-1b2d-4bca-89de-6e84acf40773 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:35.189112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261567c-1b2d-4bca-89de-6e84acf40773 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:35.189112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261567c-1b2d-4bca-89de-6e84acf40773 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:35.190487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 574/1156] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:35.196535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424153a-1968-42f8-a76f-c341c5bbeb84 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:35.196991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424153a-1968-42f8-a76f-c341c5bbeb84 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:35.197106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424153a-1968-42f8-a76f-c341c5bbeb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:35.262505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6424153a-1968-42f8-a76f-c341c5bbeb84 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:35.263698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6424153a-1968-42f8-a76f-c341c5bbeb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:35.358050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 583/1157] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:35.688492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261567c-1b2d-4bca-89de-6e84acf40773 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:35.690068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5261567c-1b2d-4bca-89de-6e84acf40773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:35.700023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:35.834856 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261567c-1b2d-4bca-89de-6e84acf40773 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:35.913902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:35.945910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf751545-6191-409d-86dc-b63444ed9016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:35.946443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751545-6191-409d-86dc-b63444ed9016 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:35.946718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751545-6191-409d-86dc-b63444ed9016 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:35.946984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf751545-6191-409d-86dc-b63444ed9016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:35.948557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cf751545-6191-409d-86dc-b63444ed9016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:36.039433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf751545-6191-409d-86dc-b63444ed9016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:36.041023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf751545-6191-409d-86dc-b63444ed9016 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:36.059173 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 575/1158] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:38.391537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88342-2331-443b-ab40-3cb140910f7d None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:38.392102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88342-2331-443b-ab40-3cb140910f7d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:38.392102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88342-2331-443b-ab40-3cb140910f7d None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:38.393454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 584/1159] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:38.398954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64118ef-5580-47be-9cde-394b55507c3e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:38.399364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64118ef-5580-47be-9cde-394b55507c3e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:38.399492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64118ef-5580-47be-9cde-394b55507c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:38.464671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c64118ef-5580-47be-9cde-394b55507c3e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:38.465910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c64118ef-5580-47be-9cde-394b55507c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:38.516506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:38.569529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 576/1160] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:38.859498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88342-2331-443b-ab40-3cb140910f7d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:38.861022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-57c88342-2331-443b-ab40-3cb140910f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:38.885512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:38.964266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88342-2331-443b-ab40-3cb140910f7d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:39.039749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12619592-928f-422c-860b-aad501afe4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:39.040351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12619592-928f-422c-860b-aad501afe4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:39.040625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12619592-928f-422c-860b-aad501afe4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:39.040892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12619592-928f-422c-860b-aad501afe4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:39.042516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-12619592-928f-422c-860b-aad501afe4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:39.118161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:39.153420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12619592-928f-422c-860b-aad501afe4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:39.155002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12619592-928f-422c-860b-aad501afe4fa service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:39.174519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 585/1161] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:41.370256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca367-7505-48f9-8405-6b70e3a52cf5 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:41.370786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca367-7505-48f9-8405-6b70e3a52cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:41.370901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca367-7505-48f9-8405-6b70e3a52cf5 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:41.372155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 577/1162] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:41.377420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156612-169e-4654-853e-b7c873082e05 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:41.377888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156612-169e-4654-853e-b7c873082e05 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:41.378003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156612-169e-4654-853e-b7c873082e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:41.443780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-60156612-169e-4654-853e-b7c873082e05 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:41.444985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-60156612-169e-4654-853e-b7c873082e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:41.542482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 586/1163] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:41.840833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ca367-7505-48f9-8405-6b70e3a52cf5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:41.842392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-046ca367-7505-48f9-8405-6b70e3a52cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:41.944289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ca367-7505-48f9-8405-6b70e3a52cf5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:42.018169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:42.019707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265e7e2-c705-4964-93b3-82ab677dc2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:42.020360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e7e2-c705-4964-93b3-82ab677dc2ed service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:42.020645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e7e2-c705-4964-93b3-82ab677dc2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:42.021118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e7e2-c705-4964-93b3-82ab677dc2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:42.023133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5265e7e2-c705-4964-93b3-82ab677dc2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:42.136736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265e7e2-c705-4964-93b3-82ab677dc2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:42.138195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265e7e2-c705-4964-93b3-82ab677dc2ed service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:42.155612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 578/1164] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:44.401129 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fb7d6-a2b9-4adb-89f8-0734db5d5667 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:44.401737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fb7d6-a2b9-4adb-89f8-0734db5d5667 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:44.401737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fb7d6-a2b9-4adb-89f8-0734db5d5667 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:44.403402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 587/1165] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:44.408915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda671d2-72de-4e5a-8cae-ec51a772d40c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:44.409315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda671d2-72de-4e5a-8cae-ec51a772d40c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:44.409457 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda671d2-72de-4e5a-8cae-ec51a772d40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:44.475682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-bda671d2-72de-4e5a-8cae-ec51a772d40c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:44.476899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bda671d2-72de-4e5a-8cae-ec51a772d40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:44.531178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:44.574664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 579/1166] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:44.863883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fb7d6-a2b9-4adb-89f8-0734db5d5667 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:44.865400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-225fb7d6-a2b9-4adb-89f8-0734db5d5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:44.901898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:44.968294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fb7d6-a2b9-4adb-89f8-0734db5d5667 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:45.041994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf75ed-831b-4266-8350-d0750e16943b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:45.042599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf75ed-831b-4266-8350-d0750e16943b service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:45.042874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf75ed-831b-4266-8350-d0750e16943b service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:45.043151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf75ed-831b-4266-8350-d0750e16943b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:45.044739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6cbf75ed-831b-4266-8350-d0750e16943b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:45.124300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:45.154287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf75ed-831b-4266-8350-d0750e16943b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:45.155719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf75ed-831b-4266-8350-d0750e16943b service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:45.173690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 588/1167] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:47.470454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643ee9-b222-4f38-8eda-ca360b498653 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:47.471019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643ee9-b222-4f38-8eda-ca360b498653 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:47.471019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643ee9-b222-4f38-8eda-ca360b498653 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:47.472326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 580/1168] 10.222.0.47 () {54 vars in 927 bytes} [Fri Oct 14 12:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:47.477748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1c50-54da-4c23-94bc-f1bedd517063 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:47.478140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1c50-54da-4c23-94bc-f1bedd517063 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:47.478302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec1c50-54da-4c23-94bc-f1bedd517063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:47.544487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-46ec1c50-54da-4c23-94bc-f1bedd517063 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:47.545749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-46ec1c50-54da-4c23-94bc-f1bedd517063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:47.641539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 589/1169] 10.222.0.47 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:47.932686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643ee9-b222-4f38-8eda-ca360b498653 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:47.934311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a3643ee9-b222-4f38-8eda-ca360b498653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:48.038368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643ee9-b222-4f38-8eda-ca360b498653 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:48.111281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a274a-7d11-46ee-8baf-b221038cf270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:48.111881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a274a-7d11-46ee-8baf-b221038cf270 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:48.112157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a274a-7d11-46ee-8baf-b221038cf270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:48.112424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a274a-7d11-46ee-8baf-b221038cf270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:48.114096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-dc2a274a-7d11-46ee-8baf-b221038cf270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:48.122465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:48.222243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a274a-7d11-46ee-8baf-b221038cf270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:48.223619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a274a-7d11-46ee-8baf-b221038cf270 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:48.241571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 581/1170] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:57.640025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=82 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:58.239332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=50 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:06.980777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c137c9-d1bc-4c84-b397-af6b01c65209 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:06.981220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c137c9-d1bc-4c84-b397-af6b01c65209 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:06.981324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c137c9-d1bc-4c84-b397-af6b01c65209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:07.056461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-81c137c9-d1bc-4c84-b397-af6b01c65209 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:56:07.057697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-81c137c9-d1bc-4c84-b397-af6b01c65209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:07.151927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 590/1171] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:56:07.160346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d955-8e39-4f34-bec5-aea829a47858 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:07.160832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d955-8e39-4f34-bec5-aea829a47858 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:07.160936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d955-8e39-4f34-bec5-aea829a47858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:07.236277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ee75d955-8e39-4f34-bec5-aea829a47858 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:56:07.237472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ee75d955-8e39-4f34-bec5-aea829a47858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:07.333588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 582/1172] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:56:07.337811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c137c9-d1bc-4c84-b397-af6b01c65209 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:07.339019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-81c137c9-d1bc-4c84-b397-af6b01c65209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:07.350995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c137c9-d1bc-4c84-b397-af6b01c65209 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:07.413233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:07.445496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:07.446111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:07.446382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:07.446645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:07.447285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:56:07.447583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:07.448588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:56:07.448588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:56:07.448588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:56:07.449501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:07.461695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 591/1173] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:56:07.471768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75d955-8e39-4f34-bec5-aea829a47858 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:07.480730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75d955-8e39-4f34-bec5-aea829a47858 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:07.541144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:07.574513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:07.575104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:07.575373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:07.575636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:07.576255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:07.577254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING py.warnings [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:56:07.577254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: warnings.warn(msg) Oct 14 12:56:07.577254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: Oct 14 12:56:07.578465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:07.634122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 583/1174] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:56:07 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:56:07.638464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:07.639980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:07.675743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cb8cc-39d9-402e-b887-843a5fa64fb7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:07.768412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:07.769015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:07.769292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:07.769597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:07.770219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:07.771253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:56:07.771253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:56:07.771253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:56:07.772462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:07.813681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 592/1175] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:56:07 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:56:07.817753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:07.819250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:07.881553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260b8c-a04b-4f38-ac7d-08ee8295e485 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:07.962932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:07.974098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:07.974708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:07.974986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:07.975257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:07.975907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:07.977560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:07.990597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 584/1176] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:56:07.994561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:07.996072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:08.008003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b27c-7073-424d-8a0e-6a135083baa4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:08.032883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:08.103305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688d4aa-e183-4d71-a687-e668d0bc1ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:08.103905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688d4aa-e183-4d71-a687-e668d0bc1ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:08.104177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688d4aa-e183-4d71-a687-e668d0bc1ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:08.104441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688d4aa-e183-4d71-a687-e668d0bc1ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:08.105069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688d4aa-e183-4d71-a687-e668d0bc1ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:08.106684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688d4aa-e183-4d71-a687-e668d0bc1ea7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:08.118917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 593/1177] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:56:08.123051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:08.124553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:08.158179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03835ba8-cf67-476a-9794-d472937bd00e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:08.249576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790082b-06a8-48e5-b305-b48f7600a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:08.250195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790082b-06a8-48e5-b305-b48f7600a095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:08.250407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790082b-06a8-48e5-b305-b48f7600a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:08.250696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790082b-06a8-48e5-b305-b48f7600a095 admin admin] PATH_INFO: `/v3/projects/6c4fd67b378841e09a48a37ffece5c34/users/f31f5d1186724936875f7620937f726e/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:08.274993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790082b-06a8-48e5-b305-b48f7600a095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4fd67b378841e09a48a37ffece5c34, user_id=f31f5d1186724936875f7620937f726e, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:08.277643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790082b-06a8-48e5-b305-b48f7600a095 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:08.301591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 585/1178] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:56:08 2022] PUT /identity/v3/projects/6c4fd67b378841e09a48a37ffece5c34/users/f31f5d1186724936875f7620937f726e/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:56:08.312558 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491f37-a8f9-42a7-958b-dd146a604fcc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:08.312843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491f37-a8f9-42a7-958b-dd146a604fcc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:08.313114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70491f37-a8f9-42a7-958b-dd146a604fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:08.370273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-70491f37-a8f9-42a7-958b-dd146a604fcc None None] MFA Rules not processed for user `f31f5d1186724936875f7620937f726e`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:56:08.371477 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-70491f37-a8f9-42a7-958b-dd146a604fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:08.450161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 594/1179] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:56:08.463235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e467ea7-f192-4615-8cf0-59af1ff4293b None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:08.463520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e467ea7-f192-4615-8cf0-59af1ff4293b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:08.463790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e467ea7-f192-4615-8cf0-59af1ff4293b None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:08.465133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 586/1180] 10.222.0.47 () {54 vars in 963 bytes} [Fri Oct 14 12:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:56:08.470257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0178-7081-4041-bc91-44a4de4983f0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:08.470537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0178-7081-4041-bc91-44a4de4983f0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:08.470806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a0178-7081-4041-bc91-44a4de4983f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:08.502296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:08.545722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9b1a0178-7081-4041-bc91-44a4de4983f0 None None] MFA Rules not processed for user `99e3385f7c3948f9ab871233626c3257`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:56:08.546923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9b1a0178-7081-4041-bc91-44a4de4983f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:08.621017 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 595/1181] 10.222.0.47 () {58 vars in 1060 bytes} [Fri Oct 14 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:56:08.628744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e467ea7-f192-4615-8cf0-59af1ff4293b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:08.630312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6e467ea7-f192-4615-8cf0-59af1ff4293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:08.680412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:08.733093 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e467ea7-f192-4615-8cf0-59af1ff4293b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:08.806524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:08.807047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:08.807319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:08.807585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:08.809143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:08.905790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:08.907250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:08.910665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:08.925401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 587/1182] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:56:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:56:08.969701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0632c-764e-4d57-8c8a-19a056b2fb63 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:08.969984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0632c-764e-4d57-8c8a-19a056b2fb63 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:08.970255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0632c-764e-4d57-8c8a-19a056b2fb63 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:08.971488 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 596/1183] 10.222.0.47 () {52 vars in 830 bytes} [Fri Oct 14 12:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:56:08.975014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:08.976255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:09.073062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c89547-7cd9-4efd-8d37-e7d093591d5c service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:09.163991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:09.164611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:09.164882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:09.165149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] PATH_INFO: `/v3/users/f31f5d1186724936875f7620937f726e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:09.178264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31f5d1186724936875f7620937f726e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:09.179277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING py.warnings [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:56:09.179277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: warnings.warn(msg) Oct 14 12:56:09.179277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: Oct 14 12:56:09.180496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:09.190619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:09.245852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31f5d1186724936875f7620937f726e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:09.268020 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31f5d1186724936875f7620937f726e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:09.268589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31f5d1186724936875f7620937f726e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:09.278478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31f5d1186724936875f7620937f726e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:09.279123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31f5d1186724936875f7620937f726e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:09.299150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 588/1184] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:56:08 2022] DELETE /identity/v3/users/f31f5d1186724936875f7620937f726e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:56:09.303523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9e76-629d-4106-ae70-9f4666d04d0f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:09.303963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9e76-629d-4106-ae70-9f4666d04d0f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:09.304077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9e76-629d-4106-ae70-9f4666d04d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:09.360928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6e6d9e76-629d-4106-ae70-9f4666d04d0f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:56:09.362157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6e6d9e76-629d-4106-ae70-9f4666d04d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:09.434909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:09.447123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 597/1185] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:56:09.457069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:09.458333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:09.556306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609aa49-355e-4e22-a513-1699d3301577 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:09.612095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:09.632728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a666a2-f441-4de7-9c7e-6502956b866f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:09.633334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a666a2-f441-4de7-9c7e-6502956b866f service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:09.633646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a666a2-f441-4de7-9c7e-6502956b866f service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:09.633919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a666a2-f441-4de7-9c7e-6502956b866f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:09.635507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-28a666a2-f441-4de7-9c7e-6502956b866f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:09.744861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a666a2-f441-4de7-9c7e-6502956b866f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:09.746326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a666a2-f441-4de7-9c7e-6502956b866f service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:09.764315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 589/1186] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:56:10.119570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9e76-629d-4106-ae70-9f4666d04d0f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:56:10.120803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6e6d9e76-629d-4106-ae70-9f4666d04d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:56:10.132844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9e76-629d-4106-ae70-9f4666d04d0f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:56:10.249180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:56:10.249859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:56:10.250142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:56:10.250415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] PATH_INFO: `/v3/projects/6c4fd67b378841e09a48a37ffece5c34` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:56:10.260752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4fd67b378841e09a48a37ffece5c34)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:56:10.261816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:56:10.261816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:56:10.261816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:56:10.263037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:56:10.321673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4fd67b378841e09a48a37ffece5c34', 'request_id': 'req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:10.327630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4fd67b378841e09a48a37ffece5c34', 'request_id': 'req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:10.341058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4fd67b378841e09a48a37ffece5c34', 'request_id': 'req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:10.367796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] The token cache is being invalidate because project 6c4fd67b378841e09a48a37ffece5c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 12:56:10.368083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:10.368501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f696b52c-cfa8-4ffc-9341-ffbda4fc0526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:56:10.369925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 598/1187] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 12:56:10 2022] DELETE /identity/v3/projects/6c4fd67b378841e09a48a37ffece5c34 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:56:19.762122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=62 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:20.365781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:37.935995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcbb86-ce1a-4c58-bf8d-7ab205830da7 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:37.936552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcbb86-ce1a-4c58-bf8d-7ab205830da7 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:37.936552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcbb86-ce1a-4c58-bf8d-7ab205830da7 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:37.937825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 590/1188] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:37.942750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af9ad-c84e-4a90-b796-ab5f85cd1e28 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:37.943191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af9ad-c84e-4a90-b796-ab5f85cd1e28 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:37.943310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af9ad-c84e-4a90-b796-ab5f85cd1e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:38.024601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a63af9ad-c84e-4a90-b796-ab5f85cd1e28 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:38.025859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a63af9ad-c84e-4a90-b796-ab5f85cd1e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:38.132169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 599/1189] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:38.288571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcbb86-ce1a-4c58-bf8d-7ab205830da7 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:38.290744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-15bcbb86-ce1a-4c58-bf8d-7ab205830da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:38.407720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcbb86-ce1a-4c58-bf8d-7ab205830da7 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:38.413261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbfa76-cba6-4ecd-a128-5e9e8ff9ae37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:38.413893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbfa76-cba6-4ecd-a128-5e9e8ff9ae37 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:38.414173 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbfa76-cba6-4ecd-a128-5e9e8ff9ae37 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:38.414445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbfa76-cba6-4ecd-a128-5e9e8ff9ae37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:38.423120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbfa76-cba6-4ecd-a128-5e9e8ff9ae37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:38.424777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbfa76-cba6-4ecd-a128-5e9e8ff9ae37 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:38.434353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 591/1190] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:57:39.347368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb802-0136-48e8-9f0d-526ecbe84ff1 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:39.347936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb802-0136-48e8-9f0d-526ecbe84ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:39.347936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb802-0136-48e8-9f0d-526ecbe84ff1 None None] PATH_INFO: `/v3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:39.349788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 600/1191] 10.222.0.18 () {54 vars in 925 bytes} [Fri Oct 14 12:57:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:57:39.355879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a636ca-47d6-4732-8943-602165792f25 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:39.356339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a636ca-47d6-4732-8943-602165792f25 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:39.356646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a636ca-47d6-4732-8943-602165792f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:39.419987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d8a636ca-47d6-4732-8943-602165792f25 None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:39.422245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d8a636ca-47d6-4732-8943-602165792f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:39.494754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:39.500462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 592/1192] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Oct 14 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:39.540300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b47b-7429-4c06-abad-aa60f3075960 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:39.540581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b47b-7429-4c06-abad-aa60f3075960 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:39.540886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405b47b-7429-4c06-abad-aa60f3075960 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:39.542294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 601/1193] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:39.548995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad193ad-3735-4944-b6af-22a6c89b73d0 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:39.549280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad193ad-3735-4944-b6af-22a6c89b73d0 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:39.549575 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad193ad-3735-4944-b6af-22a6c89b73d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:39.568807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2ad193ad-3735-4944-b6af-22a6c89b73d0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:39.570040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2ad193ad-3735-4944-b6af-22a6c89b73d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:39.578408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 593/1194] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:39.730527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405b47b-7429-4c06-abad-aa60f3075960 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:39.744927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405b47b-7429-4c06-abad-aa60f3075960 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:39.750301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39602610-fe31-4b20-8eb5-398ecbabfb2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:39.750896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39602610-fe31-4b20-8eb5-398ecbabfb2e service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:39.751173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39602610-fe31-4b20-8eb5-398ecbabfb2e service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:39.751442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39602610-fe31-4b20-8eb5-398ecbabfb2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:39.759321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39602610-fe31-4b20-8eb5-398ecbabfb2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:39.760901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39602610-fe31-4b20-8eb5-398ecbabfb2e service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:39.770519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 602/1195] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:57:43.011102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235af4b-bc90-447d-9475-23c057dbc542 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:43.011559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235af4b-bc90-447d-9475-23c057dbc542 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:43.011664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235af4b-bc90-447d-9475-23c057dbc542 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:43.013237 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 594/1196] 10.222.0.47 () {54 vars in 961 bytes} [Fri Oct 14 12:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:43.018956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1221b-3bf6-4c83-9182-02864c4e04ac None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:43.019353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1221b-3bf6-4c83-9182-02864c4e04ac None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:43.019498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1221b-3bf6-4c83-9182-02864c4e04ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:43.039013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-98f1221b-3bf6-4c83-9182-02864c4e04ac None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:43.040237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-98f1221b-3bf6-4c83-9182-02864c4e04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:43.048703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 603/1197] 10.222.0.47 () {58 vars in 1058 bytes} [Fri Oct 14 12:57:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:43.056055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235af4b-bc90-447d-9475-23c057dbc542 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:43.069829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235af4b-bc90-447d-9475-23c057dbc542 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:43.074699 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081b259-5ec5-48fd-8ae3-25a6c34bce10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:43.075277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081b259-5ec5-48fd-8ae3-25a6c34bce10 service placement] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:43.075550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081b259-5ec5-48fd-8ae3-25a6c34bce10 service placement] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:43.075817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081b259-5ec5-48fd-8ae3-25a6c34bce10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:43.084319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081b259-5ec5-48fd-8ae3-25a6c34bce10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:43.085927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081b259-5ec5-48fd-8ae3-25a6c34bce10 service placement] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:43.095195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 595/1198] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:57:51.222866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd405a-71ae-4605-95df-14583e893edb None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:51.223417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd405a-71ae-4605-95df-14583e893edb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:51.223417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd405a-71ae-4605-95df-14583e893edb None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:51.224657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 604/1199] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:51.230773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b975-0342-417d-9e87-effe58ce2d70 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:51.231221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b975-0342-417d-9e87-effe58ce2d70 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:51.231337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916b975-0342-417d-9e87-effe58ce2d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:51.251248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8916b975-0342-417d-9e87-effe58ce2d70 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:51.252426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8916b975-0342-417d-9e87-effe58ce2d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:51.260484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 596/1200] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:51.414405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd405a-71ae-4605-95df-14583e893edb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:51.428339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd405a-71ae-4605-95df-14583e893edb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:51.433693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269da51-6b62-4419-82e3-bd279c51f802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:51.434278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269da51-6b62-4419-82e3-bd279c51f802 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:51.434546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269da51-6b62-4419-82e3-bd279c51f802 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:51.434811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269da51-6b62-4419-82e3-bd279c51f802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:51.443119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269da51-6b62-4419-82e3-bd279c51f802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:51.444702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269da51-6b62-4419-82e3-bd279c51f802 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:51.454416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 605/1201] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:57:52.515649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c557-2bfc-43e1-887f-d052156bfbf7 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:52.516206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c557-2bfc-43e1-887f-d052156bfbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:52.516206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c557-2bfc-43e1-887f-d052156bfbf7 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:52.517537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 597/1202] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:52.523668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4722-480a-41a6-b64f-fae07de4ad03 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:52.524100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4722-480a-41a6-b64f-fae07de4ad03 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:52.524230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4722-480a-41a6-b64f-fae07de4ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:52.543560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ac5a4722-480a-41a6-b64f-fae07de4ad03 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:52.544728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ac5a4722-480a-41a6-b64f-fae07de4ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:52.552530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 606/1203] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:52.703469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c557-2bfc-43e1-887f-d052156bfbf7 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:52.718032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c557-2bfc-43e1-887f-d052156bfbf7 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:52.723412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16efacc-f776-4ef2-9582-7d8820903987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:52.724006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efacc-f776-4ef2-9582-7d8820903987 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:52.724279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efacc-f776-4ef2-9582-7d8820903987 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:52.724546 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efacc-f776-4ef2-9582-7d8820903987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:52.732530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16efacc-f776-4ef2-9582-7d8820903987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:52.734464 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16efacc-f776-4ef2-9582-7d8820903987 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:52.743673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 598/1204] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:57:56.687024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e6ca-ff49-4278-950a-6af9f0891ed5 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:56.687945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e6ca-ff49-4278-950a-6af9f0891ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:56.687945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e6ca-ff49-4278-950a-6af9f0891ed5 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:56.688980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 607/1205] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:56.695739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a434-2325-4a25-85e3-bd136fe2d071 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:56.695739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a434-2325-4a25-85e3-bd136fe2d071 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:56.695739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a434-2325-4a25-85e3-bd136fe2d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:56.715314 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-7766a434-2325-4a25-85e3-bd136fe2d071 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:56.716521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7766a434-2325-4a25-85e3-bd136fe2d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:56.724888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 599/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:57.016258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e6ca-ff49-4278-950a-6af9f0891ed5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:57.017986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0549e6ca-ff49-4278-950a-6af9f0891ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:57.052782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:57.099019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e6ca-ff49-4278-950a-6af9f0891ed5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:57.102620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00a2a1-55da-4ec1-98cd-6d0dee907e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:57.103224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a2a1-55da-4ec1-98cd-6d0dee907e79 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:57.103498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a2a1-55da-4ec1-98cd-6d0dee907e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:57.103767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a2a1-55da-4ec1-98cd-6d0dee907e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:57.112842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00a2a1-55da-4ec1-98cd-6d0dee907e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:57.114311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00a2a1-55da-4ec1-98cd-6d0dee907e79 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:57.123451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 608/1207] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:57:59.303233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756086d-53e8-4b6e-989b-0cbce81e1f25 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:59.303757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756086d-53e8-4b6e-989b-0cbce81e1f25 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:59.303757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756086d-53e8-4b6e-989b-0cbce81e1f25 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:59.305009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 600/1208] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:59.310561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906332b0-212b-403c-a518-b80bf679145b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:59.311644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906332b0-212b-403c-a518-b80bf679145b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:59.311744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906332b0-212b-403c-a518-b80bf679145b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:59.331165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-906332b0-212b-403c-a518-b80bf679145b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:59.332378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-906332b0-212b-403c-a518-b80bf679145b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:59.340245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 609/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:59.630248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756086d-53e8-4b6e-989b-0cbce81e1f25 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:59.631953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2756086d-53e8-4b6e-989b-0cbce81e1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:59.646590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756086d-53e8-4b6e-989b-0cbce81e1f25 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:59.650377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfbfc7-7d38-4286-ae0d-8d7868b79a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:59.650973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfbfc7-7d38-4286-ae0d-8d7868b79a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:59.651248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfbfc7-7d38-4286-ae0d-8d7868b79a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:59.651520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfbfc7-7d38-4286-ae0d-8d7868b79a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:59.660314 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfbfc7-7d38-4286-ae0d-8d7868b79a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:59.661766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfbfc7-7d38-4286-ae0d-8d7868b79a46 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:59.671395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 601/1210] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:58:03.397605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540283-f615-465a-be97-00a48bb635b8 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:03.398085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540283-f615-465a-be97-00a48bb635b8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:03.398184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540283-f615-465a-be97-00a48bb635b8 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:03.399492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 610/1211] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:58:03.405343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3fce5-145e-4a5f-8065-e7937281a2b8 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:03.405834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3fce5-145e-4a5f-8065-e7937281a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:03.405944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3fce5-145e-4a5f-8065-e7937281a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:03.425792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-e5c3fce5-145e-4a5f-8065-e7937281a2b8 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:58:03.427102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e5c3fce5-145e-4a5f-8065-e7937281a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:03.434891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 602/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:58:03.739564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96540283-f615-465a-be97-00a48bb635b8 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:58:03.741217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-96540283-f615-465a-be97-00a48bb635b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:03.817136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96540283-f615-465a-be97-00a48bb635b8 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:58:03.820648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7c984-65ef-45dd-9b29-810caf676205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:58:03.821241 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7c984-65ef-45dd-9b29-810caf676205 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:03.821539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7c984-65ef-45dd-9b29-810caf676205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:03.821813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7c984-65ef-45dd-9b29-810caf676205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:03.830980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7c984-65ef-45dd-9b29-810caf676205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:58:03.832393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7c984-65ef-45dd-9b29-810caf676205 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:58:03.841503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 611/1213] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:58:05.981698 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb470c2-a912-4a34-b5c8-9411c2fbbbc4 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:05.982181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb470c2-a912-4a34-b5c8-9411c2fbbbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:05.982276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb470c2-a912-4a34-b5c8-9411c2fbbbc4 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:05.984026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 603/1214] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:58:05.989475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ac53-51d7-44f2-8f7a-693c52b09fa8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:05.989917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ac53-51d7-44f2-8f7a-693c52b09fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:05.990025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ac53-51d7-44f2-8f7a-693c52b09fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:06.009066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-50d5ac53-51d7-44f2-8f7a-693c52b09fa8 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:58:06.010281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-50d5ac53-51d7-44f2-8f7a-693c52b09fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:06.018491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 612/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:58:06.319950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb470c2-a912-4a34-b5c8-9411c2fbbbc4 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:58:06.321634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ddb470c2-a912-4a34-b5c8-9411c2fbbbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:06.335083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb470c2-a912-4a34-b5c8-9411c2fbbbc4 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:58:06.338655 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fb8b6-67d4-4d1d-9b37-883c22364415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:58:06.339278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb8b6-67d4-4d1d-9b37-883c22364415 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:06.339557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb8b6-67d4-4d1d-9b37-883c22364415 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:06.339826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fb8b6-67d4-4d1d-9b37-883c22364415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:06.348563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fb8b6-67d4-4d1d-9b37-883c22364415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:58:06.350004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fb8b6-67d4-4d1d-9b37-883c22364415 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:58:06.359530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 604/1216] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:58:16.004348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=63 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:58:16.355102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=37 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:30.292749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead82e-a208-4e48-9ae9-304d06ab8a1a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.293932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead82e-a208-4e48-9ae9-304d06ab8a1a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.294442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ead82e-a208-4e48-9ae9-304d06ab8a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.319482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-77ead82e-a208-4e48-9ae9-304d06ab8a1a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:30.320680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-77ead82e-a208-4e48-9ae9-304d06ab8a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:30.331757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 613/1217] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:30.343301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61cfe-ac4a-4869-8a82-de4dea59b1a1 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.343900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61cfe-ac4a-4869-8a82-de4dea59b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.343900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61cfe-ac4a-4869-8a82-de4dea59b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.369361 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-eec61cfe-ac4a-4869-8a82-de4dea59b1a1 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:30.370607 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-eec61cfe-ac4a-4869-8a82-de4dea59b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:30.385678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 605/1218] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:30.391206 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ead82e-a208-4e48-9ae9-304d06ab8a1a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:30.404526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ead82e-a208-4e48-9ae9-304d06ab8a1a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:30.413152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:30.413791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.414065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.414333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.414979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:30.415276 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:30.416869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:30.433878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 614/1219] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:30.441930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61cfe-ac4a-4869-8a82-de4dea59b1a1 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:30.454878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61cfe-ac4a-4869-8a82-de4dea59b1a1 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:30.461836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd93e9-fae5-41df-8d1c-9f07a291cde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:30.462475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd93e9-fae5-41df-8d1c-9f07a291cde9 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.462754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd93e9-fae5-41df-8d1c-9f07a291cde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.463188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd93e9-fae5-41df-8d1c-9f07a291cde9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.463853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd93e9-fae5-41df-8d1c-9f07a291cde9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:30.466708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd93e9-fae5-41df-8d1c-9f07a291cde9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:30.524644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 606/1220] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:30.528856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:30.546628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90acaed-1f68-43d9-86b6-d30a7c7511cd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:30.636471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbca6b-3cdd-425b-91cb-7788d6c354f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:30.638429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbca6b-3cdd-425b-91cb-7788d6c354f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.638704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbca6b-3cdd-425b-91cb-7788d6c354f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.638973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbca6b-3cdd-425b-91cb-7788d6c354f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.639606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbca6b-3cdd-425b-91cb-7788d6c354f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:30.641564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbca6b-3cdd-425b-91cb-7788d6c354f5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:30.667706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 615/1221] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:30.671793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd93e9-fae5-41df-8d1c-9f07a291cde9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:30.688978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376913-739a-482f-b91e-c89077616ddf None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.689308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376913-739a-482f-b91e-c89077616ddf None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.689601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6376913-739a-482f-b91e-c89077616ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.691174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd93e9-fae5-41df-8d1c-9f07a291cde9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:30.700975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39096f2f-e9eb-4163-8af6-a5d71af92230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:30.701772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39096f2f-e9eb-4163-8af6-a5d71af92230 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.702057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39096f2f-e9eb-4163-8af6-a5d71af92230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.702449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39096f2f-e9eb-4163-8af6-a5d71af92230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.702990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39096f2f-e9eb-4163-8af6-a5d71af92230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:30.704634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39096f2f-e9eb-4163-8af6-a5d71af92230 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:30.723292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a6376913-739a-482f-b91e-c89077616ddf None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:30.724534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a6376913-739a-482f-b91e-c89077616ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:30.727742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 607/1222] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:30.735008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39096f2f-e9eb-4163-8af6-a5d71af92230 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:30.738227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 616/1223] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:30.750835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17809ac1-e80a-4171-a9e5-06b995c315b4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.751148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17809ac1-e80a-4171-a9e5-06b995c315b4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.751384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17809ac1-e80a-4171-a9e5-06b995c315b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.751506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39096f2f-e9eb-4163-8af6-a5d71af92230 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:30.761409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21a87e-d73b-4535-aaaa-9ff8b516e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:30.762649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21a87e-d73b-4535-aaaa-9ff8b516e6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.762938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21a87e-d73b-4535-aaaa-9ff8b516e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.763211 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21a87e-d73b-4535-aaaa-9ff8b516e6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.763883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21a87e-d73b-4535-aaaa-9ff8b516e6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:30.771168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21a87e-d73b-4535-aaaa-9ff8b516e6bf admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:30.779811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-17809ac1-e80a-4171-a9e5-06b995c315b4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:30.781023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-17809ac1-e80a-4171-a9e5-06b995c315b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:30.791844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 608/1224] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 12:59:30.796438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21a87e-d73b-4535-aaaa-9ff8b516e6bf admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:30.799394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 617/1225] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:59:30.804404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17809ac1-e80a-4171-a9e5-06b995c315b4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:30.813966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21a87e-d73b-4535-aaaa-9ff8b516e6bf admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:30.821114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17809ac1-e80a-4171-a9e5-06b995c315b4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:30.821776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277c6e6-9e11-43b2-9932-d9083ace005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:30.822832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c6e6-9e11-43b2-9932-d9083ace005f admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.823121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c6e6-9e11-43b2-9932-d9083ace005f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.823396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c6e6-9e11-43b2-9932-d9083ace005f admin admin] PATH_INFO: `/v3/projects/d108f710c68845a8b01b30a67183a4a0/users/fdc206c2cdca4686b297459f6ab1db75/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.826469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90490d-efc7-4b21-b5e9-bb69babd2425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:30.827102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90490d-efc7-4b21-b5e9-bb69babd2425 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.827377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90490d-efc7-4b21-b5e9-bb69babd2425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.827648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90490d-efc7-4b21-b5e9-bb69babd2425 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.828405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90490d-efc7-4b21-b5e9-bb69babd2425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:30.828710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90490d-efc7-4b21-b5e9-bb69babd2425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:30.835060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90490d-efc7-4b21-b5e9-bb69babd2425 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:30.853721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 618/1226] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:30.855478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437390ac-ea1b-4909-a422-53ce42131726 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.855822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437390ac-ea1b-4909-a422-53ce42131726 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.856078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437390ac-ea1b-4909-a422-53ce42131726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.866866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277c6e6-9e11-43b2-9932-d9083ace005f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d108f710c68845a8b01b30a67183a4a0, user_id=fdc206c2cdca4686b297459f6ab1db75, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:30.869630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277c6e6-9e11-43b2-9932-d9083ace005f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:30.887042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-437390ac-ea1b-4909-a422-53ce42131726 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:30.888834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-437390ac-ea1b-4909-a422-53ce42131726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:30.900197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 609/1227] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:30 2022] PUT /identity/v3/projects/d108f710c68845a8b01b30a67183a4a0/users/fdc206c2cdca4686b297459f6ab1db75/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:59:30.901582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768def2-d4f5-4034-94c5-a454bb29f902 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.901871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768def2-d4f5-4034-94c5-a454bb29f902 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.902144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768def2-d4f5-4034-94c5-a454bb29f902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.951292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f768def2-d4f5-4034-94c5-a454bb29f902 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:30.952537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f768def2-d4f5-4034-94c5-a454bb29f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:30.959204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 619/1228] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:30.960940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437390ac-ea1b-4909-a422-53ce42131726 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:30.972555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 610/1229] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:30.972826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437390ac-ea1b-4909-a422-53ce42131726 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:30.977865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cfd75-b1ea-4e26-9fc2-626952a4b71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:30.979149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cfd75-b1ea-4e26-9fc2-626952a4b71f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.979671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cfd75-b1ea-4e26-9fc2-626952a4b71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.980149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cfd75-b1ea-4e26-9fc2-626952a4b71f admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:30.981965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cfd75-b1ea-4e26-9fc2-626952a4b71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:30.983397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-b10cfd75-b1ea-4e26-9fc2-626952a4b71f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:59:30.983397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:59:30.983397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:59:30.985314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cfd75-b1ea-4e26-9fc2-626952a4b71f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:30.986864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e8da-a458-4f76-83b3-3d5c549ed2d7 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:30.987114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e8da-a458-4f76-83b3-3d5c549ed2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:30.987376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e8da-a458-4f76-83b3-3d5c549ed2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.015694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-bf99e8da-a458-4f76-83b3-3d5c549ed2d7 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.017669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bf99e8da-a458-4f76-83b3-3d5c549ed2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.022748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 620/1230] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/projects => generated 391 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.026536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c4d5d-288c-42bd-8504-95cb7fe27a9e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.026536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c4d5d-288c-42bd-8504-95cb7fe27a9e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.026536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c4d5d-288c-42bd-8504-95cb7fe27a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.030886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 611/1231] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.032402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f21c8-f87b-4326-ba38-88a54c60c951 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.032947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f21c8-f87b-4326-ba38-88a54c60c951 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.033438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f21c8-f87b-4326-ba38-88a54c60c951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.055391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ec2f21c8-f87b-4326-ba38-88a54c60c951 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.057432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ec2f21c8-f87b-4326-ba38-88a54c60c951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.060506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-099c4d5d-288c-42bd-8504-95cb7fe27a9e None None] MFA Rules not processed for user `fdc206c2cdca4686b297459f6ab1db75`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.061743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-099c4d5d-288c-42bd-8504-95cb7fe27a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.073070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:31.123909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 612/1232] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.125160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9e94-3a14-4838-91c2-aaae606b9572 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.125441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9e94-3a14-4838-91c2-aaae606b9572 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.125742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9e94-3a14-4838-91c2-aaae606b9572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.135203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 621/1233] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.136583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c5afa-83da-4c75-9f80-9677054583d0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.137041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c5afa-83da-4c75-9f80-9677054583d0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.137315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c5afa-83da-4c75-9f80-9677054583d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.148983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-440c9e94-3a14-4838-91c2-aaae606b9572 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.150208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-440c9e94-3a14-4838-91c2-aaae606b9572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.158836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 613/1234] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.159715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c9e94-3a14-4838-91c2-aaae606b9572 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.160716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d83c5afa-83da-4c75-9f80-9677054583d0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.162089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d83c5afa-83da-4c75-9f80-9677054583d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.170088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c9e94-3a14-4838-91c2-aaae606b9572 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.173562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 622/1235] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.175435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062003a-111c-4c81-89a6-75c19e97d2a2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.175811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062003a-111c-4c81-89a6-75c19e97d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.176139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062003a-111c-4c81-89a6-75c19e97d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.176253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9d899-0ca3-4d16-8a89-487ce38640b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.177105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9d899-0ca3-4d16-8a89-487ce38640b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.177374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9d899-0ca3-4d16-8a89-487ce38640b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.177717 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9d899-0ca3-4d16-8a89-487ce38640b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.178391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9d899-0ca3-4d16-8a89-487ce38640b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.179443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING py.warnings [None req-eff9d899-0ca3-4d16-8a89-487ce38640b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:59:31.179443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: warnings.warn(msg) Oct 14 12:59:31.179443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: Oct 14 12:59:31.180653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9d899-0ca3-4d16-8a89-487ce38640b3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.198586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3062003a-111c-4c81-89a6-75c19e97d2a2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.200518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3062003a-111c-4c81-89a6-75c19e97d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.210000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 614/1236] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/users => generated 296 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.210000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba1cc-2fff-4ac2-b2df-582aae117539 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.210000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba1cc-2fff-4ac2-b2df-582aae117539 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.210000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba1cc-2fff-4ac2-b2df-582aae117539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.212709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 623/1237] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.213944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431c67-13cf-46e9-b4bd-bde80a6610d9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.214226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431c67-13cf-46e9-b4bd-bde80a6610d9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.214497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431c67-13cf-46e9-b4bd-bde80a6610d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.228134 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-855ba1cc-2fff-4ac2-b2df-582aae117539 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.229744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-855ba1cc-2fff-4ac2-b2df-582aae117539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.234215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7b431c67-13cf-46e9-b4bd-bde80a6610d9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.235360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7b431c67-13cf-46e9-b4bd-bde80a6610d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.238883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 615/1238] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.240432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2baa3-3c33-4253-98af-c84721f5117a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.240750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2baa3-3c33-4253-98af-c84721f5117a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.241030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2baa3-3c33-4253-98af-c84721f5117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.250208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 624/1239] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.251191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b431c67-13cf-46e9-b4bd-bde80a6610d9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.265338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-60a2baa3-3c33-4253-98af-c84721f5117a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.266572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-60a2baa3-3c33-4253-98af-c84721f5117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.266734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b431c67-13cf-46e9-b4bd-bde80a6610d9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.271248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.271848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.272121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.272388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.273030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:31.273326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.274468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 616/1240] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.274951 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.275698 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6c76-41e9-4632-9d20-b08ffdd0965c None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.275982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6c76-41e9-4632-9d20-b08ffdd0965c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.276251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6c76-41e9-4632-9d20-b08ffdd0965c None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.277461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 617/1241] 10.222.0.47 () {54 vars in 961 bytes} [Fri Oct 14 12:59:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:31.282296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a6c76-41e9-4632-9d20-b08ffdd0965c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.289310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 625/1242] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:31.290048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.298622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a6c76-41e9-4632-9d20-b08ffdd0965c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.301915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52465c2-d060-4b81-9644-e5a098428efc admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.303132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.303723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.303992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.304256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.304894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:31.305191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.306300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING py.warnings [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:59:31.306300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: warnings.warn(msg) Oct 14 12:59:31.306300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: Oct 14 12:59:31.306566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a838f3e-0d35-4953-922d-fbb292cb8c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.307097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.307205 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a838f3e-0d35-4953-922d-fbb292cb8c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.307445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a838f3e-0d35-4953-922d-fbb292cb8c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.307717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a838f3e-0d35-4953-922d-fbb292cb8c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.308348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a838f3e-0d35-4953-922d-fbb292cb8c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.310507 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a838f3e-0d35-4953-922d-fbb292cb8c61 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.319304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 618/1243] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:31.320267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.320684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 626/1244] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:31.321876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c05a8d-41ac-47b2-85fd-faabe693fc02 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.322157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c05a8d-41ac-47b2-85fd-faabe693fc02 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.322428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c05a8d-41ac-47b2-85fd-faabe693fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.334489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6b354-3ace-44f3-9d42-81d52c56afdc admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.339661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.340783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.341066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.341338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.341992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-42c05a8d-41ac-47b2-85fd-faabe693fc02 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.342133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:31.342316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.343168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-42c05a8d-41ac-47b2-85fd-faabe693fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.343908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.351424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 627/1245] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.352579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743e4e-4e5a-42a0-8c7c-c8f6adeebe3e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.352861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743e4e-4e5a-42a0-8c7c-c8f6adeebe3e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.353135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743e4e-4e5a-42a0-8c7c-c8f6adeebe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.353298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:31.360198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 619/1246] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:31.361375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.372816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a1d3c-eb22-4098-bba5-41f76758014e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.373350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ce743e4e-4e5a-42a0-8c7c-c8f6adeebe3e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.374586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ce743e4e-4e5a-42a0-8c7c-c8f6adeebe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.377472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.378086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.378359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.378629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.379268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:31.379565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.381136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.382643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 628/1247] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.383790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e2fc-7136-4fe6-abde-cf1c30e618e0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.384065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e2fc-7136-4fe6-abde-cf1c30e618e0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.384333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3e2fc-7136-4fe6-abde-cf1c30e618e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.395721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 620/1248] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:31.396566 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.407448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0c16a-0ad5-458a-b8e4-4b09d7a7acc2 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.412317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b7885-e4f9-49d1-9bc2-35ae5b5b62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.412897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b7885-e4f9-49d1-9bc2-35ae5b5b62f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.413173 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b7885-e4f9-49d1-9bc2-35ae5b5b62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.413447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b7885-e4f9-49d1-9bc2-35ae5b5b62f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.414103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b7885-e4f9-49d1-9bc2-35ae5b5b62f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.415975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b7885-e4f9-49d1-9bc2-35ae5b5b62f7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.424235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-48b3e2fc-7136-4fe6-abde-cf1c30e618e0 None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:31.425538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-48b3e2fc-7136-4fe6-abde-cf1c30e618e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:31.442927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 621/1249] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.443733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b7885-e4f9-49d1-9bc2-35ae5b5b62f7 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.494337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 629/1250] 10.222.0.47 () {58 vars in 1058 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:31.495152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e2fc-7136-4fe6-abde-cf1c30e618e0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.504997 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3e2fc-7136-4fe6-abde-cf1c30e618e0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.506501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b7885-e4f9-49d1-9bc2-35ae5b5b62f7 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.509610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0eb1ee-fd1b-46f5-8b7e-5ce15c414990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.510196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0eb1ee-fd1b-46f5-8b7e-5ce15c414990 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.510499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0eb1ee-fd1b-46f5-8b7e-5ce15c414990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.510770 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0eb1ee-fd1b-46f5-8b7e-5ce15c414990 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.511387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0eb1ee-fd1b-46f5-8b7e-5ce15c414990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.511508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71277d60-e777-4464-912a-a08c877e6b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.512040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277d60-e777-4464-912a-a08c877e6b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.512319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277d60-e777-4464-912a-a08c877e6b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.512585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277d60-e777-4464-912a-a08c877e6b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.513228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71277d60-e777-4464-912a-a08c877e6b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.513341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0eb1ee-fd1b-46f5-8b7e-5ce15c414990 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.514850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71277d60-e777-4464-912a-a08c877e6b57 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.524479 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 622/1251] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:31.525405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71277d60-e777-4464-912a-a08c877e6b57 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.536015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71277d60-e777-4464-912a-a08c877e6b57 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.540819 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.541440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.541688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.541958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.542586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:31.542884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.543249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 630/1252] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.544718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0eb1ee-fd1b-46f5-8b7e-5ce15c414990 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.545043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.557244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:31.557921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 623/1253] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:31.558910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.568392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651b474-f653-4987-9f02-fd13ea607732 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.612709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0eb1ee-fd1b-46f5-8b7e-5ce15c414990 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.617765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937304e-c81e-495f-a279-abfd751cecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.618370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937304e-c81e-495f-a279-abfd751cecfe admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.618735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937304e-c81e-495f-a279-abfd751cecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.618906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937304e-c81e-495f-a279-abfd751cecfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.619530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937304e-c81e-495f-a279-abfd751cecfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.621565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937304e-c81e-495f-a279-abfd751cecfe admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.625991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.625991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.626424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.626763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.627407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:31.627712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.629303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.640552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 624/1254] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:31.641317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.652088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 631/1255] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.652088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937304e-c81e-495f-a279-abfd751cecfe admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.658854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf682cb-dc05-4c43-8447-5aa0f2522eb3 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.698772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:31.714265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937304e-c81e-495f-a279-abfd751cecfe admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.716743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb43d6-82d4-4928-9cf8-b8422dbad8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.717351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb43d6-82d4-4928-9cf8-b8422dbad8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.717657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb43d6-82d4-4928-9cf8-b8422dbad8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.717927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb43d6-82d4-4928-9cf8-b8422dbad8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.718558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb43d6-82d4-4928-9cf8-b8422dbad8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.719582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd098-a6da-4c6d-b4f4-be00213e6499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.720183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd098-a6da-4c6d-b4f4-be00213e6499 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.720461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd098-a6da-4c6d-b4f4-be00213e6499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.720646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb43d6-82d4-4928-9cf8-b8422dbad8d0 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.720738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd098-a6da-4c6d-b4f4-be00213e6499 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.721374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd098-a6da-4c6d-b4f4-be00213e6499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.723331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd098-a6da-4c6d-b4f4-be00213e6499 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.746802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 632/1256] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.747765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd098-a6da-4c6d-b4f4-be00213e6499 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.754100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 625/1257] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.754100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb43d6-82d4-4928-9cf8-b8422dbad8d0 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.811882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb43d6-82d4-4928-9cf8-b8422dbad8d0 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.816359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403d8d1-bb26-4230-bdd8-e7d6a896e0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.817005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403d8d1-bb26-4230-bdd8-e7d6a896e0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.817276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403d8d1-bb26-4230-bdd8-e7d6a896e0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.817576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403d8d1-bb26-4230-bdd8-e7d6a896e0e6 admin admin] PATH_INFO: `/v3/projects/c160176d8c804b7793bae21c205c538c/users/60860294eb284b8aa11edd42dca4ae8d/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.820952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd098-a6da-4c6d-b4f4-be00213e6499 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.831792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403d8d1-bb26-4230-bdd8-e7d6a896e0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c160176d8c804b7793bae21c205c538c, user_id=60860294eb284b8aa11edd42dca4ae8d, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.834470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403d8d1-bb26-4230-bdd8-e7d6a896e0e6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.842249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:31.849515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 626/1258] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:31 2022] PUT /identity/v3/projects/c160176d8c804b7793bae21c205c538c/users/60860294eb284b8aa11edd42dca4ae8d/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:31.850550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403d8d1-bb26-4230-bdd8-e7d6a896e0e6 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.891956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb780619-8658-4c35-9d06-bf680233c1db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.892547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb780619-8658-4c35-9d06-bf680233c1db service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.892820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb780619-8658-4c35-9d06-bf680233c1db service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.893089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb780619-8658-4c35-9d06-bf680233c1db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.913344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403d8d1-bb26-4230-bdd8-e7d6a896e0e6 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.918079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eea4b-cf65-43a1-bef8-52a8f8054b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.918738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eea4b-cf65-43a1-bef8-52a8f8054b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.919012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eea4b-cf65-43a1-bef8-52a8f8054b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.919412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eea4b-cf65-43a1-bef8-52a8f8054b60 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.920069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eea4b-cf65-43a1-bef8-52a8f8054b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.922000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eea4b-cf65-43a1-bef8-52a8f8054b60 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.944597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 627/1259] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.945623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eea4b-cf65-43a1-bef8-52a8f8054b60 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.952159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb780619-8658-4c35-9d06-bf680233c1db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.953911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb780619-8658-4c35-9d06-bf680233c1db service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.956133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eea4b-cf65-43a1-bef8-52a8f8054b60 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.960778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f010-9ec8-4951-a7f4-d3cdcd520d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.961359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f010-9ec8-4951-a7f4-d3cdcd520d2a admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.961671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f010-9ec8-4951-a7f4-d3cdcd520d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.961945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479f010-9ec8-4951-a7f4-d3cdcd520d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.962594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f010-9ec8-4951-a7f4-d3cdcd520d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.962851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 633/1260] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:31.963596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb780619-8658-4c35-9d06-bf680233c1db service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:31.964625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479f010-9ec8-4951-a7f4-d3cdcd520d2a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.973866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb780619-8658-4c35-9d06-bf680233c1db service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:31.984458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eca60d-180e-4869-acf3-6f9cf4913b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:31.985109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eca60d-180e-4869-acf3-6f9cf4913b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:31.985339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eca60d-180e-4869-acf3-6f9cf4913b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:31.985709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eca60d-180e-4869-acf3-6f9cf4913b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:31.986425 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eca60d-180e-4869-acf3-6f9cf4913b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:31.988766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eca60d-180e-4869-acf3-6f9cf4913b9a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:31.995909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 628/1261] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:31.996766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f010-9ec8-4951-a7f4-d3cdcd520d2a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.019466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 634/1262] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:32.019880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eca60d-180e-4869-acf3-6f9cf4913b9a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.020349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.076483 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479f010-9ec8-4951-a7f4-d3cdcd520d2a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.092251 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eca60d-180e-4869-acf3-6f9cf4913b9a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.098453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aef945-65e7-452e-acd0-ecd7d27b323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.099066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aef945-65e7-452e-acd0-ecd7d27b323f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.099464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aef945-65e7-452e-acd0-ecd7d27b323f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.099754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aef945-65e7-452e-acd0-ecd7d27b323f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.100403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aef945-65e7-452e-acd0-ecd7d27b323f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.102896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aef945-65e7-452e-acd0-ecd7d27b323f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.117660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 635/1263] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.118580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aef945-65e7-452e-acd0-ecd7d27b323f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.129779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aef945-65e7-452e-acd0-ecd7d27b323f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.134457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0d95e-66f7-4648-ab11-c1ae2a394182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.135038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d95e-66f7-4648-ab11-c1ae2a394182 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.135316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d95e-66f7-4648-ab11-c1ae2a394182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.135632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0d95e-66f7-4648-ab11-c1ae2a394182 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.136201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0d95e-66f7-4648-ab11-c1ae2a394182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.137775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2512f1c-7ea7-4b8c-aa95-6f85b186edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.138384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512f1c-7ea7-4b8c-aa95-6f85b186edea admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.138675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512f1c-7ea7-4b8c-aa95-6f85b186edea admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.138779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0d95e-66f7-4648-ab11-c1ae2a394182 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.138948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512f1c-7ea7-4b8c-aa95-6f85b186edea admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.139535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2512f1c-7ea7-4b8c-aa95-6f85b186edea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.141581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2512f1c-7ea7-4b8c-aa95-6f85b186edea admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.162736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 636/1264] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:32 2022] POST /identity/v3/users => generated 303 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:32.165074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9a23-c936-457c-9d04-3aacb537720b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.165791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9a23-c936-457c-9d04-3aacb537720b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.166018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9a23-c936-457c-9d04-3aacb537720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.180067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 629/1265] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:31 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:32.180067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2512f1c-7ea7-4b8c-aa95-6f85b186edea admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.190383 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2512f1c-7ea7-4b8c-aa95-6f85b186edea admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.191529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-687b9a23-c936-457c-9d04-3aacb537720b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:32.194705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-687b9a23-c936-457c-9d04-3aacb537720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:32.201760 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb876b-ca77-42e4-be89-e6d915cf063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.202612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb876b-ca77-42e4-be89-e6d915cf063d admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.202959 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb876b-ca77-42e4-be89-e6d915cf063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.203299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb876b-ca77-42e4-be89-e6d915cf063d admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.204037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb876b-ca77-42e4-be89-e6d915cf063d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.205847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb876b-ca77-42e4-be89-e6d915cf063d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.210227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 637/1266] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:32.211056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9a23-c936-457c-9d04-3aacb537720b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.218984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 630/1267] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.220140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb876b-ca77-42e4-be89-e6d915cf063d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.223983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9a23-c936-457c-9d04-3aacb537720b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.229403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f21192-7895-4ddb-b1dd-1e4d18d660cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.230258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f21192-7895-4ddb-b1dd-1e4d18d660cc admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.230537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f21192-7895-4ddb-b1dd-1e4d18d660cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.230843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb876b-ca77-42e4-be89-e6d915cf063d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.230946 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f21192-7895-4ddb-b1dd-1e4d18d660cc admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.231568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f21192-7895-4ddb-b1dd-1e4d18d660cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.233515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f21192-7895-4ddb-b1dd-1e4d18d660cc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.236261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764fd2-3b8c-48ac-8df2-401d4103dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.236921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764fd2-3b8c-48ac-8df2-401d4103dae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.237271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764fd2-3b8c-48ac-8df2-401d4103dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.237654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764fd2-3b8c-48ac-8df2-401d4103dae7 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.238339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31764fd2-3b8c-48ac-8df2-401d4103dae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.240445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31764fd2-3b8c-48ac-8df2-401d4103dae7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.244482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.263835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 638/1268] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:32 2022] POST /identity/v3/users => generated 290 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:32.263835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f21192-7895-4ddb-b1dd-1e4d18d660cc admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.269545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 631/1269] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:32 2022] POST /identity/v3/users => generated 279 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:32.269545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764fd2-3b8c-48ac-8df2-401d4103dae7 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.276165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f21192-7895-4ddb-b1dd-1e4d18d660cc admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.280378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764fd2-3b8c-48ac-8df2-401d4103dae7 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.281434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164c819-49ac-4e8a-b656-1c8d0ebc29f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.282050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164c819-49ac-4e8a-b656-1c8d0ebc29f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.282435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164c819-49ac-4e8a-b656-1c8d0ebc29f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.282711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164c819-49ac-4e8a-b656-1c8d0ebc29f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.283346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164c819-49ac-4e8a-b656-1c8d0ebc29f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.284932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164c819-49ac-4e8a-b656-1c8d0ebc29f6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.285194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73d05b-08f2-41d8-a544-4e86194de609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.285909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d05b-08f2-41d8-a544-4e86194de609 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.286234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d05b-08f2-41d8-a544-4e86194de609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.286462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d05b-08f2-41d8-a544-4e86194de609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.287101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73d05b-08f2-41d8-a544-4e86194de609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.288665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73d05b-08f2-41d8-a544-4e86194de609 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.296221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 639/1270] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.297096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164c819-49ac-4e8a-b656-1c8d0ebc29f6 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.301020 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 632/1271] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.304694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73d05b-08f2-41d8-a544-4e86194de609 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.310451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164c819-49ac-4e8a-b656-1c8d0ebc29f6 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.316412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8682d8d-dc0b-4441-a8aa-aa37f51b6d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.317073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8682d8d-dc0b-4441-a8aa-aa37f51b6d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.317433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8682d8d-dc0b-4441-a8aa-aa37f51b6d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.317791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8682d8d-dc0b-4441-a8aa-aa37f51b6d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.318521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8682d8d-dc0b-4441-a8aa-aa37f51b6d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.320166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8682d8d-dc0b-4441-a8aa-aa37f51b6d04 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.333171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 640/1272] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.333171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8682d8d-dc0b-4441-a8aa-aa37f51b6d04 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.343029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8682d8d-dc0b-4441-a8aa-aa37f51b6d04 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.348591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c81e6-91c3-404a-ae8f-9ab9aec1abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.349275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c81e6-91c3-404a-ae8f-9ab9aec1abc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.349698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c81e6-91c3-404a-ae8f-9ab9aec1abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.350044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c81e6-91c3-404a-ae8f-9ab9aec1abc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.350860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c81e6-91c3-404a-ae8f-9ab9aec1abc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.352577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c81e6-91c3-404a-ae8f-9ab9aec1abc0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.364059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 641/1273] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.364813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c81e6-91c3-404a-ae8f-9ab9aec1abc0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.369760 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73d05b-08f2-41d8-a544-4e86194de609 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.373762 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ea52f-c14d-4bda-9ffc-b806bcd59475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.374510 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ea52f-c14d-4bda-9ffc-b806bcd59475 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.374691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c81e6-91c3-404a-ae8f-9ab9aec1abc0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.375150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ea52f-c14d-4bda-9ffc-b806bcd59475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.375528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ea52f-c14d-4bda-9ffc-b806bcd59475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.379332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e555-7b9d-4cc0-aae5-1494f6971359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.379961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e555-7b9d-4cc0-aae5-1494f6971359 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.380245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e555-7b9d-4cc0-aae5-1494f6971359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.380517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277e555-7b9d-4cc0-aae5-1494f6971359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.381142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277e555-7b9d-4cc0-aae5-1494f6971359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.382759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277e555-7b9d-4cc0-aae5-1494f6971359 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.385310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ea52f-c14d-4bda-9ffc-b806bcd59475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.386837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ea52f-c14d-4bda-9ffc-b806bcd59475 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.394450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 642/1274] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.395261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e555-7b9d-4cc0-aae5-1494f6971359 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.399482 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 633/1275] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:32.402364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ea52f-c14d-4bda-9ffc-b806bcd59475 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.410509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277e555-7b9d-4cc0-aae5-1494f6971359 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.415797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874a77-ecd6-4766-bed7-708d736b500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.416393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874a77-ecd6-4766-bed7-708d736b500c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.416633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ea52f-c14d-4bda-9ffc-b806bcd59475 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.416777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874a77-ecd6-4766-bed7-708d736b500c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.417171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874a77-ecd6-4766-bed7-708d736b500c admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.417858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874a77-ecd6-4766-bed7-708d736b500c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.419567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874a77-ecd6-4766-bed7-708d736b500c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.424673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5186a7c-62e4-4eae-8db9-7faf2c37a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.428027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186a7c-62e4-4eae-8db9-7faf2c37a801 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.428752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186a7c-62e4-4eae-8db9-7faf2c37a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.429027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5186a7c-62e4-4eae-8db9-7faf2c37a801 admin admin] PATH_INFO: `/v3/projects/61022b5907954d90b88dade684aa27ab/users/edd93bdc7a804b399b976baf88c45164/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.435707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 643/1276] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.435707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874a77-ecd6-4766-bed7-708d736b500c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.445738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874a77-ecd6-4766-bed7-708d736b500c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.450187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5186a7c-62e4-4eae-8db9-7faf2c37a801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61022b5907954d90b88dade684aa27ab, user_id=edd93bdc7a804b399b976baf88c45164, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.451232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ebcbd-453e-47eb-8798-21081370cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.451842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ebcbd-453e-47eb-8798-21081370cd4f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.452121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ebcbd-453e-47eb-8798-21081370cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.452390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ebcbd-453e-47eb-8798-21081370cd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.452820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5186a7c-62e4-4eae-8db9-7faf2c37a801 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.453028 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ebcbd-453e-47eb-8798-21081370cd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.454638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ebcbd-453e-47eb-8798-21081370cd4f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.455129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.467511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 644/1277] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.468477 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ebcbd-453e-47eb-8798-21081370cd4f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.475518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 634/1278] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:32 2022] PUT /identity/v3/projects/61022b5907954d90b88dade684aa27ab/users/edd93bdc7a804b399b976baf88c45164/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:32.476676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5186a7c-62e4-4eae-8db9-7faf2c37a801 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.492751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ebcbd-453e-47eb-8798-21081370cd4f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.559555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5186a7c-62e4-4eae-8db9-7faf2c37a801 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.562419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b31011-3f00-4570-8df1-24d5257a9135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.563033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31011-3f00-4570-8df1-24d5257a9135 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.563310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31011-3f00-4570-8df1-24d5257a9135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.563581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31011-3f00-4570-8df1-24d5257a9135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.564250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b31011-3f00-4570-8df1-24d5257a9135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.564554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1261340-71ae-4bcb-b6ae-84600519a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.565269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261340-71ae-4bcb-b6ae-84600519a6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.565642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261340-71ae-4bcb-b6ae-84600519a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.565878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b31011-3f00-4570-8df1-24d5257a9135 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.566000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261340-71ae-4bcb-b6ae-84600519a6e5 admin admin] PATH_INFO: `/v3/projects/9247e549c63f4a42be20f5a7aeda0594/users/9394667740f44bcab24ee484b195fe96/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.576707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 645/1279] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.577913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b31011-3f00-4570-8df1-24d5257a9135 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.587664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1261340-71ae-4bcb-b6ae-84600519a6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9247e549c63f4a42be20f5a7aeda0594, user_id=9394667740f44bcab24ee484b195fe96, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.588139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b31011-3f00-4570-8df1-24d5257a9135 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.591064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1261340-71ae-4bcb-b6ae-84600519a6e5 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.593906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17b49b-92f3-4bef-85a0-5f53b2ca02a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.594509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17b49b-92f3-4bef-85a0-5f53b2ca02a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.594786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17b49b-92f3-4bef-85a0-5f53b2ca02a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.595058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17b49b-92f3-4bef-85a0-5f53b2ca02a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.595777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17b49b-92f3-4bef-85a0-5f53b2ca02a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.597285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17b49b-92f3-4bef-85a0-5f53b2ca02a2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.606933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 635/1280] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:32 2022] PUT /identity/v3/projects/9247e549c63f4a42be20f5a7aeda0594/users/9394667740f44bcab24ee484b195fe96/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:32.611227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 646/1281] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.611336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17b49b-92f3-4bef-85a0-5f53b2ca02a2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.612440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1261340-71ae-4bcb-b6ae-84600519a6e5 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.624821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17b49b-92f3-4bef-85a0-5f53b2ca02a2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.682853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1261340-71ae-4bcb-b6ae-84600519a6e5 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.688512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7a0ca-f3e5-4919-8377-7f4adba8bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.689299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7a0ca-f3e5-4919-8377-7f4adba8bab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.689728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7a0ca-f3e5-4919-8377-7f4adba8bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.690224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7a0ca-f3e5-4919-8377-7f4adba8bab3 admin admin] PATH_INFO: `/v3/projects/4395038db67b47ac812c8db2493b2b15/users/982e2a1ccc0a49a6b242988d73d68036/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.691278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac394f-0253-4096-b824-aabaff983074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.692116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac394f-0253-4096-b824-aabaff983074 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.692116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac394f-0253-4096-b824-aabaff983074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.692415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac394f-0253-4096-b824-aabaff983074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.693191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac394f-0253-4096-b824-aabaff983074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.694868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac394f-0253-4096-b824-aabaff983074 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.706768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7a0ca-f3e5-4919-8377-7f4adba8bab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4395038db67b47ac812c8db2493b2b15, user_id=982e2a1ccc0a49a6b242988d73d68036, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.709572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 647/1282] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:32.709572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b1166-01ab-42e9-8a8a-eacb5186aa0d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.709572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b1166-01ab-42e9-8a8a-eacb5186aa0d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.709572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b1166-01ab-42e9-8a8a-eacb5186aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.709989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7a0ca-f3e5-4919-8377-7f4adba8bab3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.728070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 636/1283] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:32 2022] PUT /identity/v3/projects/4395038db67b47ac812c8db2493b2b15/users/982e2a1ccc0a49a6b242988d73d68036/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:32.729586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7410-aceb-496b-a798-4a324c99c71a None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.729949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7410-aceb-496b-a798-4a324c99c71a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.730223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7410-aceb-496b-a798-4a324c99c71a None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.731799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 637/1284] 10.222.0.47 () {54 vars in 961 bytes} [Fri Oct 14 12:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:32.732404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7410-aceb-496b-a798-4a324c99c71a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.740258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.751819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-978b1166-01ab-42e9-8a8a-eacb5186aa0d None None] MFA Rules not processed for user `edd93bdc7a804b399b976baf88c45164`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:32.753755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-978b1166-01ab-42e9-8a8a-eacb5186aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:32.819557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7410-aceb-496b-a798-4a324c99c71a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.833716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0e45a-9a3e-411d-af19-84d2fa653c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.834905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e45a-9a3e-411d-af19-84d2fa653c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.835031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 648/1285] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:32.835598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e45a-9a3e-411d-af19-84d2fa653c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.836305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e45a-9a3e-411d-af19-84d2fa653c58 admin admin] PATH_INFO: `/v3/projects/6c0d083e8cef4333b9514d2256991647/users/0bcbf6513b6a4df3b044fadfb7888d54/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.836825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db028-1b62-465f-94df-34a4a019bb84 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.837151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db028-1b62-465f-94df-34a4a019bb84 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.837471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4db028-1b62-465f-94df-34a4a019bb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.841054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.860569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0e45a-9a3e-411d-af19-84d2fa653c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0d083e8cef4333b9514d2256991647, user_id=0bcbf6513b6a4df3b044fadfb7888d54, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.861611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8f4db028-1b62-465f-94df-34a4a019bb84 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:32.862942 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8f4db028-1b62-465f-94df-34a4a019bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:32.863751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0e45a-9a3e-411d-af19-84d2fa653c58 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.876879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 649/1286] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:32.876879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4db028-1b62-465f-94df-34a4a019bb84 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.884310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 638/1287] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:32 2022] PUT /identity/v3/projects/6c0d083e8cef4333b9514d2256991647/users/0bcbf6513b6a4df3b044fadfb7888d54/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:32.885238 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0e45a-9a3e-411d-af19-84d2fa653c58 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:32.895762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4db028-1b62-465f-94df-34a4a019bb84 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.952147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0e45a-9a3e-411d-af19-84d2fa653c58 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:32.957101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784843ae-91df-4445-8ac8-14c84033cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.957800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784843ae-91df-4445-8ac8-14c84033cbee admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.958080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784843ae-91df-4445-8ac8-14c84033cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.958351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784843ae-91df-4445-8ac8-14c84033cbee admin admin] PATH_INFO: `/v3/projects/e69202a735614390a60b78f3d9e6af06/users/e0cf023a86ba47e9a2bb86343a71c1c9/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.960947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518befa-d95d-4bb7-beed-4a0c103cd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:32.962214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518befa-d95d-4bb7-beed-4a0c103cd535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:32.962214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518befa-d95d-4bb7-beed-4a0c103cd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:32.962415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518befa-d95d-4bb7-beed-4a0c103cd535 admin admin] PATH_INFO: `/v3/projects/758ac8ee488d498882fce45dc7255676/users/4a23786597854812a0931f8622ce38c7/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:32.974956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784843ae-91df-4445-8ac8-14c84033cbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69202a735614390a60b78f3d9e6af06, user_id=e0cf023a86ba47e9a2bb86343a71c1c9, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.977709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784843ae-91df-4445-8ac8-14c84033cbee admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.982563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518befa-d95d-4bb7-beed-4a0c103cd535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758ac8ee488d498882fce45dc7255676, user_id=4a23786597854812a0931f8622ce38c7, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:32.986070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518befa-d95d-4bb7-beed-4a0c103cd535 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:32.996984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 639/1288] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:32 2022] PUT /identity/v3/projects/e69202a735614390a60b78f3d9e6af06/users/e0cf023a86ba47e9a2bb86343a71c1c9/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:33.007523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ebbd-282a-40ae-87c5-a8e6b5ac688a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.007523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ebbd-282a-40ae-87c5-a8e6b5ac688a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.007523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8ebbd-282a-40ae-87c5-a8e6b5ac688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.015680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 650/1289] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:32 2022] PUT /identity/v3/projects/758ac8ee488d498882fce45dc7255676/users/4a23786597854812a0931f8622ce38c7/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:33.016878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160af20-1974-4363-9276-4c6aa4be3418 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.017157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160af20-1974-4363-9276-4c6aa4be3418 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.017423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160af20-1974-4363-9276-4c6aa4be3418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.022705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-06d8ebbd-282a-40ae-87c5-a8e6b5ac688a None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:33.024117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-06d8ebbd-282a-40ae-87c5-a8e6b5ac688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:33.048104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d160af20-1974-4363-9276-4c6aa4be3418 None None] MFA Rules not processed for user `982e2a1ccc0a49a6b242988d73d68036`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:33.049347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d160af20-1974-4363-9276-4c6aa4be3418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:33.107346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 640/1290] 10.222.0.47 () {58 vars in 1058 bytes} [Fri Oct 14 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:33.108460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8ebbd-282a-40ae-87c5-a8e6b5ac688a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.122979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 651/1291] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:33.122979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160af20-1974-4363-9276-4c6aa4be3418 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.127684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:33.176488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:33.181751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8ebbd-282a-40ae-87c5-a8e6b5ac688a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:33.187807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160af20-1974-4363-9276-4c6aa4be3418 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:33.187972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2610a-f979-427e-a0f7-aabe54a19faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:33.188643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2610a-f979-427e-a0f7-aabe54a19faf admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.189561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2610a-f979-427e-a0f7-aabe54a19faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.190153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2610a-f979-427e-a0f7-aabe54a19faf admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.190678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2610a-f979-427e-a0f7-aabe54a19faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:33.192154 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95b58c-946b-4b46-9607-68c57b6b68a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:33.192771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b58c-946b-4b46-9607-68c57b6b68a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.193153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2610a-f979-427e-a0f7-aabe54a19faf admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:33.193275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b58c-946b-4b46-9607-68c57b6b68a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.193444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b58c-946b-4b46-9607-68c57b6b68a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.203966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95b58c-946b-4b46-9607-68c57b6b68a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:33.205448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95b58c-946b-4b46-9607-68c57b6b68a6 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:33.218937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 652/1292] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:33.218937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142f0dc-b969-4fe0-89d4-2e81e763807d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.218937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142f0dc-b969-4fe0-89d4-2e81e763807d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.218937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142f0dc-b969-4fe0-89d4-2e81e763807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.234602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 641/1293] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:33.235975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167813db-6ba7-432b-9400-35a108bed9cf None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.236264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167813db-6ba7-432b-9400-35a108bed9cf None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.236588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167813db-6ba7-432b-9400-35a108bed9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.257563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d142f0dc-b969-4fe0-89d4-2e81e763807d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:33.258839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d142f0dc-b969-4fe0-89d4-2e81e763807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:33.403816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 653/1294] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:33.407508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e285ca-968a-4fda-94ab-688a2a8e460e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.408691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e285ca-968a-4fda-94ab-688a2a8e460e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.409698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e285ca-968a-4fda-94ab-688a2a8e460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.420097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-167813db-6ba7-432b-9400-35a108bed9cf None None] MFA Rules not processed for user `e0cf023a86ba47e9a2bb86343a71c1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:33.422804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-167813db-6ba7-432b-9400-35a108bed9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:33.454258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-31e285ca-968a-4fda-94ab-688a2a8e460e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:33.455485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-31e285ca-968a-4fda-94ab-688a2a8e460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:33.470773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 654/1295] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:33.472492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1840d18-12a0-4e0c-b612-c0758fa157b3 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.472920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1840d18-12a0-4e0c-b612-c0758fa157b3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.473235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1840d18-12a0-4e0c-b612-c0758fa157b3 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.474903 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 655/1296] 10.222.0.47 () {54 vars in 912 bytes} [Fri Oct 14 12:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:33.475755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1840d18-12a0-4e0c-b612-c0758fa157b3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.493905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1840d18-12a0-4e0c-b612-c0758fa157b3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:33.500991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc40f-1b47-4be3-8e4c-53506524f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:33.501646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc40f-1b47-4be3-8e4c-53506524f502 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.501921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc40f-1b47-4be3-8e4c-53506524f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.503183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccc40f-1b47-4be3-8e4c-53506524f502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.504008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccc40f-1b47-4be3-8e4c-53506524f502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:33.506636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccc40f-1b47-4be3-8e4c-53506524f502 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:33.539216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 642/1297] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:33.540230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167813db-6ba7-432b-9400-35a108bed9cf None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.554511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167813db-6ba7-432b-9400-35a108bed9cf None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:33.559373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 656/1298] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/projects => generated 403 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:33.560932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc40f-1b47-4be3-8e4c-53506524f502 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.630019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857633e-d49a-488c-8e3e-30f79da88db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:33.630829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857633e-d49a-488c-8e3e-30f79da88db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.631260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857633e-d49a-488c-8e3e-30f79da88db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.631571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857633e-d49a-488c-8e3e-30f79da88db2 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.632307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857633e-d49a-488c-8e3e-30f79da88db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:33.634516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857633e-d49a-488c-8e3e-30f79da88db2 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:33.673139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 643/1299] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:33.677548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0289aad-89ce-448c-af8a-8e142974dcca None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.677965 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0289aad-89ce-448c-af8a-8e142974dcca None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.678304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0289aad-89ce-448c-af8a-8e142974dcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.686119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccc40f-1b47-4be3-8e4c-53506524f502 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:33.696128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49b58-830b-46a3-b1fd-4a201e0c4a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:33.697948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49b58-830b-46a3-b1fd-4a201e0c4a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.700353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49b58-830b-46a3-b1fd-4a201e0c4a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.700756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49b58-830b-46a3-b1fd-4a201e0c4a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.709034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d0289aad-89ce-448c-af8a-8e142974dcca None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:33.714150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d0289aad-89ce-448c-af8a-8e142974dcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:33.720606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49b58-830b-46a3-b1fd-4a201e0c4a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:33.725437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49b58-830b-46a3-b1fd-4a201e0c4a4f service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:33.755520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 657/1300] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:33.756663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49b58-830b-46a3-b1fd-4a201e0c4a4f service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.792377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49b58-830b-46a3-b1fd-4a201e0c4a4f service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:33.799240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87711e-7734-4482-be62-1c5b779aacc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:33.800329 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87711e-7734-4482-be62-1c5b779aacc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.800711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87711e-7734-4482-be62-1c5b779aacc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.801584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87711e-7734-4482-be62-1c5b779aacc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.816189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87711e-7734-4482-be62-1c5b779aacc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:33.818371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87711e-7734-4482-be62-1c5b779aacc8 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:33.833170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 658/1301] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:33.834387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87711e-7734-4482-be62-1c5b779aacc8 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.847698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87711e-7734-4482-be62-1c5b779aacc8 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:33.848995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:33.854644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437296f-e709-4ff3-abbe-678c7697543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:33.855800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437296f-e709-4ff3-abbe-678c7697543c admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.856184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437296f-e709-4ff3-abbe-678c7697543c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.856956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437296f-e709-4ff3-abbe-678c7697543c admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.857796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437296f-e709-4ff3-abbe-678c7697543c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:33.860346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437296f-e709-4ff3-abbe-678c7697543c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:33.867702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:33.878716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 644/1302] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:33.885448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0289aad-89ce-448c-af8a-8e142974dcca None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.904964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0289aad-89ce-448c-af8a-8e142974dcca None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:33.910616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a8e10-7c4e-4d66-ace4-4669730aca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:33.911245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a8e10-7c4e-4d66-ace4-4669730aca4b admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:33.911519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a8e10-7c4e-4d66-ace4-4669730aca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:33.911837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a8e10-7c4e-4d66-ace4-4669730aca4b admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:33.912817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a8e10-7c4e-4d66-ace4-4669730aca4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:33.914992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a8e10-7c4e-4d66-ace4-4669730aca4b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:33.925476 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 659/1303] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/projects => generated 357 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:33.926435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437296f-e709-4ff3-abbe-678c7697543c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:33.946758 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 645/1304] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:33 2022] POST /identity/v3/users => generated 308 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:33.948056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a8e10-7c4e-4d66-ace4-4669730aca4b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.067952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a8e10-7c4e-4d66-ace4-4669730aca4b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.078733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437296f-e709-4ff3-abbe-678c7697543c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.095650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf3545-f997-4ee1-9ce6-52fa1da4e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.096287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf3545-f997-4ee1-9ce6-52fa1da4e9da admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.096567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf3545-f997-4ee1-9ce6-52fa1da4e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.096842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf3545-f997-4ee1-9ce6-52fa1da4e9da admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.097513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf3545-f997-4ee1-9ce6-52fa1da4e9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.099138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf3545-f997-4ee1-9ce6-52fa1da4e9da admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.125870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 660/1305] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:34.131277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf3545-f997-4ee1-9ce6-52fa1da4e9da admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.147867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e78017-dd52-4811-bfce-7dea72e6d9be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.149326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e78017-dd52-4811-bfce-7dea72e6d9be service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.149688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e78017-dd52-4811-bfce-7dea72e6d9be service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.150090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e78017-dd52-4811-bfce-7dea72e6d9be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.153825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf3545-f997-4ee1-9ce6-52fa1da4e9da admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.159422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316e62d-2617-4b18-a466-b103d60285d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.160189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e62d-2617-4b18-a466-b103d60285d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.160471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e62d-2617-4b18-a466-b103d60285d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.160745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316e62d-2617-4b18-a466-b103d60285d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.161384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316e62d-2617-4b18-a466-b103d60285d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.163422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316e62d-2617-4b18-a466-b103d60285d2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.191618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 661/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:34 2022] POST /identity/v3/users => generated 285 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:34.192467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316e62d-2617-4b18-a466-b103d60285d2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.208333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316e62d-2617-4b18-a466-b103d60285d2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.224365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38b485-9c73-4210-a980-710da41dcea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.225071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b485-9c73-4210-a980-710da41dcea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.225356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b485-9c73-4210-a980-710da41dcea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.226502 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38b485-9c73-4210-a980-710da41dcea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.227208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38b485-9c73-4210-a980-710da41dcea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.232686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38b485-9c73-4210-a980-710da41dcea7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.258683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 662/1307] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:34.260012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38b485-9c73-4210-a980-710da41dcea7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.282085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e78017-dd52-4811-bfce-7dea72e6d9be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.288735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38b485-9c73-4210-a980-710da41dcea7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.288930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e78017-dd52-4811-bfce-7dea72e6d9be service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.305963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00e82-83c2-438b-aa42-de14064f5557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.307178 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00e82-83c2-438b-aa42-de14064f5557 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.311015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00e82-83c2-438b-aa42-de14064f5557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.311015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00e82-83c2-438b-aa42-de14064f5557 admin admin] PATH_INFO: `/v3/projects/20a2e30e9d9d4426b6ebe83205fb212a/users/ad0c75bedca0453bb4ad38da2fab7f44/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.334188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 646/1308] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:34.360454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e78017-dd52-4811-bfce-7dea72e6d9be service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.363246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a00e82-83c2-438b-aa42-de14064f5557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a2e30e9d9d4426b6ebe83205fb212a, user_id=ad0c75bedca0453bb4ad38da2fab7f44, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.366596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a00e82-83c2-438b-aa42-de14064f5557 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.394917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 663/1309] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:34 2022] PUT /identity/v3/projects/20a2e30e9d9d4426b6ebe83205fb212a/users/ad0c75bedca0453bb4ad38da2fab7f44/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:34.395818 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00e82-83c2-438b-aa42-de14064f5557 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.406313 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e78017-dd52-4811-bfce-7dea72e6d9be service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.503317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:34.534754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00e82-83c2-438b-aa42-de14064f5557 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.548581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350192f-afa2-45d9-8713-f39505741a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.550323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350192f-afa2-45d9-8713-f39505741a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.550323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350192f-afa2-45d9-8713-f39505741a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.550323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350192f-afa2-45d9-8713-f39505741a3f admin admin] PATH_INFO: `/v3/projects/29b7dcecd1a04c7f81adb42baabb8d5b/users/44c8ecad976043d1bdfc84a332b37538/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.567870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b744-5e88-4837-918f-09872661e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.568521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b744-5e88-4837-918f-09872661e766 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.568855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b744-5e88-4837-918f-09872661e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.569307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b744-5e88-4837-918f-09872661e766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.570230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b744-5e88-4837-918f-09872661e766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.572493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b744-5e88-4837-918f-09872661e766 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.599968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350192f-afa2-45d9-8713-f39505741a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b7dcecd1a04c7f81adb42baabb8d5b, user_id=44c8ecad976043d1bdfc84a332b37538, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.604185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 647/1310] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:34.605402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b744-5e88-4837-918f-09872661e766 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.610109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350192f-afa2-45d9-8713-f39505741a3f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.627492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b744-5e88-4837-918f-09872661e766 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.632717 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a81a81-1aae-4564-a75b-33df47abbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.633328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a81a81-1aae-4564-a75b-33df47abbdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.633688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a81a81-1aae-4564-a75b-33df47abbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.634011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a81a81-1aae-4564-a75b-33df47abbdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.635228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a81a81-1aae-4564-a75b-33df47abbdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.638084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a81a81-1aae-4564-a75b-33df47abbdc6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.648714 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 664/1311] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:34 2022] PUT /identity/v3/projects/29b7dcecd1a04c7f81adb42baabb8d5b/users/44c8ecad976043d1bdfc84a332b37538/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:34.649501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350192f-afa2-45d9-8713-f39505741a3f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.669563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 648/1312] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:34.670530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a81a81-1aae-4564-a75b-33df47abbdc6 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.681709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:34.691636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a81a81-1aae-4564-a75b-33df47abbdc6 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.796678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350192f-afa2-45d9-8713-f39505741a3f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:34.804964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830030a-6a68-41eb-a573-fcc4536c91d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.807168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830030a-6a68-41eb-a573-fcc4536c91d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.807461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830030a-6a68-41eb-a573-fcc4536c91d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.807740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830030a-6a68-41eb-a573-fcc4536c91d7 admin admin] PATH_INFO: `/v3/projects/f7f1c0f057d747aab372762552f4cdad/users/d28e279cf1de408c85d135b49a81128e/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.831121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d5bc5-587a-41d9-ab0d-6fff5be4f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:34.833197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5bc5-587a-41d9-ab0d-6fff5be4f6be admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.833495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5bc5-587a-41d9-ab0d-6fff5be4f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.833779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d5bc5-587a-41d9-ab0d-6fff5be4f6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.834715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d5bc5-587a-41d9-ab0d-6fff5be4f6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.840684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d5bc5-587a-41d9-ab0d-6fff5be4f6be admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.847931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830030a-6a68-41eb-a573-fcc4536c91d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f1c0f057d747aab372762552f4cdad, user_id=d28e279cf1de408c85d135b49a81128e, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:34.854498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830030a-6a68-41eb-a573-fcc4536c91d7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:34.867502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 649/1313] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:34.868492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d5bc5-587a-41d9-ab0d-6fff5be4f6be admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.887835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 665/1314] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:34 2022] PUT /identity/v3/projects/f7f1c0f057d747aab372762552f4cdad/users/d28e279cf1de408c85d135b49a81128e/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:34.889385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38e667-70e2-409c-b1f4-8356337062f9 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:34.892320 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38e667-70e2-409c-b1f4-8356337062f9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:34.892584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38e667-70e2-409c-b1f4-8356337062f9 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:34.896776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 666/1315] 10.222.0.47 () {54 vars in 912 bytes} [Fri Oct 14 12:59:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:34.897655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38e667-70e2-409c-b1f4-8356337062f9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:34.899536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d5bc5-587a-41d9-ab0d-6fff5be4f6be admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:35.027344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38e667-70e2-409c-b1f4-8356337062f9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:35.032324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c4d90-12e3-4a20-b297-2b01130839d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:35.033013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4d90-12e3-4a20-b297-2b01130839d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.033291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4d90-12e3-4a20-b297-2b01130839d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.033600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4d90-12e3-4a20-b297-2b01130839d1 admin admin] PATH_INFO: `/v3/projects/29b7dcecd1a04c7f81adb42baabb8d5b/users/44c8ecad976043d1bdfc84a332b37538/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.035907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c4d90-12e3-4a20-b297-2b01130839d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b7dcecd1a04c7f81adb42baabb8d5b, user_id=44c8ecad976043d1bdfc84a332b37538, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:35.039760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c4d90-12e3-4a20-b297-2b01130839d1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:35.052294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a2ade-e15b-495a-8966-26826da70711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:35.053394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a2ade-e15b-495a-8966-26826da70711 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.053981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a2ade-e15b-495a-8966-26826da70711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.054547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a2ade-e15b-495a-8966-26826da70711 admin admin] PATH_INFO: `/v3/projects/20a2e30e9d9d4426b6ebe83205fb212a/users/ad0c75bedca0453bb4ad38da2fab7f44/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.054811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 667/1316] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:34 2022] PUT /identity/v3/projects/29b7dcecd1a04c7f81adb42baabb8d5b/users/44c8ecad976043d1bdfc84a332b37538/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:35.055681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c4d90-12e3-4a20-b297-2b01130839d1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:35.058650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a2ade-e15b-495a-8966-26826da70711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a2e30e9d9d4426b6ebe83205fb212a, user_id=ad0c75bedca0453bb4ad38da2fab7f44, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:35.062120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a2ade-e15b-495a-8966-26826da70711 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:35.092204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 650/1317] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:34 2022] PUT /identity/v3/projects/20a2e30e9d9d4426b6ebe83205fb212a/users/ad0c75bedca0453bb4ad38da2fab7f44/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:35.092204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02777020-aee1-4796-be54-9f02a2425697 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.092204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02777020-aee1-4796-be54-9f02a2425697 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.092204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02777020-aee1-4796-be54-9f02a2425697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.155316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-02777020-aee1-4796-be54-9f02a2425697 None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:35.159036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-02777020-aee1-4796-be54-9f02a2425697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:35.179772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c4d90-12e3-4a20-b297-2b01130839d1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:35.307670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:35.308270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:35.308487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c051156-7519-47f1-8705-da0a5ca731f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:35.308487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051156-7519-47f1-8705-da0a5ca731f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.308487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051156-7519-47f1-8705-da0a5ca731f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.308487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c051156-7519-47f1-8705-da0a5ca731f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.308911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c051156-7519-47f1-8705-da0a5ca731f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:35.308911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c051156-7519-47f1-8705-da0a5ca731f6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:35.324040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 668/1318] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:35.326037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc325-d71a-4494-889e-9dee29cd33db None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.326617 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc325-d71a-4494-889e-9dee29cd33db None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.327396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc325-d71a-4494-889e-9dee29cd33db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.346749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 651/1319] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:35.347797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fa2b8-aed0-45d8-8671-b4e57151751f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.348087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fa2b8-aed0-45d8-8671-b4e57151751f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.348360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fa2b8-aed0-45d8-8671-b4e57151751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.372305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-343dc325-d71a-4494-889e-9dee29cd33db None None] MFA Rules not processed for user `44c8ecad976043d1bdfc84a332b37538`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:35.374095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-343dc325-d71a-4494-889e-9dee29cd33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:35.426321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f20fa2b8-aed0-45d8-8671-b4e57151751f None None] MFA Rules not processed for user `ad0c75bedca0453bb4ad38da2fab7f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:35.427568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f20fa2b8-aed0-45d8-8671-b4e57151751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:35.480656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 669/1320] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:35.481740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc325-d71a-4494-889e-9dee29cd33db None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:35.496522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc325-d71a-4494-889e-9dee29cd33db None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:35.501752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be694-f6d5-4352-8946-964c53c8312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:35.502568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be694-f6d5-4352-8946-964c53c8312b admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.502969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be694-f6d5-4352-8946-964c53c8312b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.503522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be694-f6d5-4352-8946-964c53c8312b admin admin] PATH_INFO: `/v3/projects/f7f1c0f057d747aab372762552f4cdad/users/d28e279cf1de408c85d135b49a81128e/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.505902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14be694-f6d5-4352-8946-964c53c8312b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f1c0f057d747aab372762552f4cdad, user_id=d28e279cf1de408c85d135b49a81128e, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:35.509063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14be694-f6d5-4352-8946-964c53c8312b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:35.522846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 670/1321] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:35 2022] PUT /identity/v3/projects/f7f1c0f057d747aab372762552f4cdad/users/d28e279cf1de408c85d135b49a81128e/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:35.523693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be694-f6d5-4352-8946-964c53c8312b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:35.593961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 652/1322] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:35.594833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fa2b8-aed0-45d8-8671-b4e57151751f None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:35.614893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be694-f6d5-4352-8946-964c53c8312b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:35.619059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ef6f2-5a65-4b94-90a3-4a1a0c9c8b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:35.619879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef6f2-5a65-4b94-90a3-4a1a0c9c8b29 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.620261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef6f2-5a65-4b94-90a3-4a1a0c9c8b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.620639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef6f2-5a65-4b94-90a3-4a1a0c9c8b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.705787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:35.721111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fa2b8-aed0-45d8-8671-b4e57151751f None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:35.730278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ef6f2-5a65-4b94-90a3-4a1a0c9c8b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:35.732248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ef6f2-5a65-4b94-90a3-4a1a0c9c8b29 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:35.738049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49408e8-ac1b-441e-af2a-8fabeb824a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:35.738049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49408e8-ac1b-441e-af2a-8fabeb824a19 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.738049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49408e8-ac1b-441e-af2a-8fabeb824a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.738049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49408e8-ac1b-441e-af2a-8fabeb824a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.750362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 671/1323] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:35.753976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3e9c3-54d3-4195-aff6-54134798e55c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.754817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3e9c3-54d3-4195-aff6-54134798e55c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.755197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3e9c3-54d3-4195-aff6-54134798e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:35.797532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7ff3e9c3-54d3-4195-aff6-54134798e55c None None] MFA Rules not processed for user `d28e279cf1de408c85d135b49a81128e`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:35.799465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7ff3e9c3-54d3-4195-aff6-54134798e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:35.900522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49408e8-ac1b-441e-af2a-8fabeb824a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:35.902255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49408e8-ac1b-441e-af2a-8fabeb824a19 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:35.907066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 672/1324] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:35.907066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3e9c3-54d3-4195-aff6-54134798e55c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:35.919116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3e9c3-54d3-4195-aff6-54134798e55c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:35.922656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 653/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:35.923859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773b05-9c8f-4d67-bb8c-d500d7e6a10f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:35.924516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773b05-9c8f-4d67-bb8c-d500d7e6a10f service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:35.924796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773b05-9c8f-4d67-bb8c-d500d7e6a10f service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:35.925068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773b05-9c8f-4d67-bb8c-d500d7e6a10f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:36.054259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773b05-9c8f-4d67-bb8c-d500d7e6a10f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:36.057055 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773b05-9c8f-4d67-bb8c-d500d7e6a10f service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:36.070760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 673/1326] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:36.123155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49408e8-ac1b-441e-af2a-8fabeb824a19 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:36.128105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773b05-9c8f-4d67-bb8c-d500d7e6a10f service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:36.150401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773b05-9c8f-4d67-bb8c-d500d7e6a10f service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:36.161151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc6df-d5a4-4b3a-aa96-636a4d184193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:36.167693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:36.176177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc6df-d5a4-4b3a-aa96-636a4d184193 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:36.177913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc6df-d5a4-4b3a-aa96-636a4d184193 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:36.178195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dc6df-d5a4-4b3a-aa96-636a4d184193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:36.205408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dc6df-d5a4-4b3a-aa96-636a4d184193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:36.207438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dc6df-d5a4-4b3a-aa96-636a4d184193 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:36.250708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 674/1327] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:36.292999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49408e8-ac1b-441e-af2a-8fabeb824a19 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:36.343927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:36.344584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:36.344863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:36.345451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] PATH_INFO: `/v3/users/fdc206c2cdca4686b297459f6ab1db75` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:36.347843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc206c2cdca4686b297459f6ab1db75)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:36.349835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:36.439861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc6df-d5a4-4b3a-aa96-636a4d184193 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:36.457928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dc6df-d5a4-4b3a-aa96-636a4d184193 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:36.471690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcff6b5-d91e-4f39-8889-ebbe553630fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:36.472731 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcff6b5-d91e-4f39-8889-ebbe553630fd service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:36.473021 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcff6b5-d91e-4f39-8889-ebbe553630fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:36.473292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcff6b5-d91e-4f39-8889-ebbe553630fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:36.487838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc206c2cdca4686b297459f6ab1db75'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.523623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc206c2cdca4686b297459f6ab1db75'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.524843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc206c2cdca4686b297459f6ab1db75'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.537834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc206c2cdca4686b297459f6ab1db75'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.539003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc206c2cdca4686b297459f6ab1db75'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.567390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 654/1328] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:36 2022] DELETE /identity/v3/users/fdc206c2cdca4686b297459f6ab1db75 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:36.568426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:36.573333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:36.623180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:36.657900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcff6b5-d91e-4f39-8889-ebbe553630fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:36.661864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcff6b5-d91e-4f39-8889-ebbe553630fd service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:36.688464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 675/1329] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:59:36.690149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcff6b5-d91e-4f39-8889-ebbe553630fd service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:36.709962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcff6b5-d91e-4f39-8889-ebbe553630fd service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:36.728426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7479ee-a0b2-40b3-aa29-59c2fbdd52f6 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:36.736229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:36.737298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:36.737774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:36.738379 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] PATH_INFO: `/v3/users/982e2a1ccc0a49a6b242988d73d68036` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:36.739889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=982e2a1ccc0a49a6b242988d73d68036)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:36.742190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:36.802117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:36.834363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982e2a1ccc0a49a6b242988d73d68036'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.856577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d24dbc-0b8d-4c77-9f8d-69504b861a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:36.857782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d24dbc-0b8d-4c77-9f8d-69504b861a13 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:36.858075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d24dbc-0b8d-4c77-9f8d-69504b861a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:36.858332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d24dbc-0b8d-4c77-9f8d-69504b861a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:36.866536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-05d24dbc-0b8d-4c77-9f8d-69504b861a13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:36.870332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982e2a1ccc0a49a6b242988d73d68036'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.872267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982e2a1ccc0a49a6b242988d73d68036'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.888966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982e2a1ccc0a49a6b242988d73d68036'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.890079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-451caf87-8e64-4fc0-b4dc-86c81b123dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982e2a1ccc0a49a6b242988d73d68036'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:36.922666 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 655/1330] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:36 2022] DELETE /identity/v3/users/982e2a1ccc0a49a6b242988d73d68036 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:36.924412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7573f-2d65-4738-9338-45d2426d6838 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:36.924886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7573f-2d65-4738-9338-45d2426d6838 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:36.925165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7573f-2d65-4738-9338-45d2426d6838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:36.967156 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a5c7573f-2d65-4738-9338-45d2426d6838 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:36.968486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a5c7573f-2d65-4738-9338-45d2426d6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:37.017542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d24dbc-0b8d-4c77-9f8d-69504b861a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:37.019032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d24dbc-0b8d-4c77-9f8d-69504b861a13 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:37.031423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 676/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:37.032727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89e596-ee77-4abc-8a32-ee694431901d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:37.033006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89e596-ee77-4abc-8a32-ee694431901d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:37.033277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89e596-ee77-4abc-8a32-ee694431901d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:37.086376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6d89e596-ee77-4abc-8a32-ee694431901d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:37.088450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6d89e596-ee77-4abc-8a32-ee694431901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:37.189979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 656/1332] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:37.218192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7573f-2d65-4738-9338-45d2426d6838 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:37.224519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 677/1333] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:37.224984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a5c7573f-2d65-4738-9338-45d2426d6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:37.265743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89e596-ee77-4abc-8a32-ee694431901d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:37.268211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6d89e596-ee77-4abc-8a32-ee694431901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:37.353207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7573f-2d65-4738-9338-45d2426d6838 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:37.364668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:37.366651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:37.366993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:37.367273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:37.391644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:37.392092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:37.393862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:37.417429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89e596-ee77-4abc-8a32-ee694431901d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:37.420952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 657/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:37.435758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:37.436399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:37.436678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:37.442537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:37.488151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:37.489999 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:37.518970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 678/1335] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:39.622780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:39.625577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:39.651301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25437-97d3-4c31-bdde-bea9e5b7ce84 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:39.672450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:39.673200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:39.673498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:39.673820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] PATH_INFO: `/v3/projects/d108f710c68845a8b01b30a67183a4a0` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:39.675125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d108f710c68845a8b01b30a67183a4a0)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:39.677016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: WARNING py.warnings [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:59:39.677016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: warnings.warn(msg) Oct 14 12:59:39.677016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: Oct 14 12:59:39.680709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:39.687670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:39.690188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:39.719444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0003-9732-483e-8a6a-36438d38d449 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:39.749870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:39.750408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:39.750684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:39.750985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] PATH_INFO: `/v3/projects/4395038db67b47ac812c8db2493b2b15` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:39.753619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4395038db67b47ac812c8db2493b2b15)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:39.759472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:39.957064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd108f710c68845a8b01b30a67183a4a0', 'request_id': 'req-2a6c689a-72cd-4073-ac72-d9eb411008cc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:39.970759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:40.012399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd108f710c68845a8b01b30a67183a4a0', 'request_id': 'req-2a6c689a-72cd-4073-ac72-d9eb411008cc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.021424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4395038db67b47ac812c8db2493b2b15', 'request_id': 'req-fc398961-decb-41bf-9c17-cf29a2b974f3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.045823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4395038db67b47ac812c8db2493b2b15', 'request_id': 'req-fc398961-decb-41bf-9c17-cf29a2b974f3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.068321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd108f710c68845a8b01b30a67183a4a0', 'request_id': 'req-2a6c689a-72cd-4073-ac72-d9eb411008cc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.077882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4395038db67b47ac812c8db2493b2b15', 'request_id': 'req-fc398961-decb-41bf-9c17-cf29a2b974f3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.120012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] The token cache is being invalidate because project d108f710c68845a8b01b30a67183a4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 12:59:40.120249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.129039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2a6c689a-72cd-4073-ac72-d9eb411008cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.137370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 658/1336] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 12:59:39 2022] DELETE /identity/v3/projects/d108f710c68845a8b01b30a67183a4a0 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:40.137579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] The token cache is being invalidate because project 4395038db67b47ac812c8db2493b2b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 12:59:40.137935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.141031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.142801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 679/1337] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 12:59:39 2022] DELETE /identity/v3/projects/4395038db67b47ac812c8db2493b2b15 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:40.150443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256f85-ad96-4f63-a309-4f1809a07363 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:40.150725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256f85-ad96-4f63-a309-4f1809a07363 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:40.151003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da256f85-ad96-4f63-a309-4f1809a07363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:40.159172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:40.162497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:40.255013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-da256f85-ad96-4f63-a309-4f1809a07363 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:40.256308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-da256f85-ad96-4f63-a309-4f1809a07363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:40.431708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398961-decb-41bf-9c17-cf29a2b974f3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:40.451801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:40.452460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:40.453344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:40.453344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] PATH_INFO: `/v3/users/44c8ecad976043d1bdfc84a332b37538` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:40.455175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c8ecad976043d1bdfc84a332b37538)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:40.456094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: WARNING py.warnings [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:59:40.456094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: warnings.warn(msg) Oct 14 12:59:40.456094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: Oct 14 12:59:40.462447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:40.486386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 659/1338] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:40.497619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473282d0-51fc-401b-b71f-012cdedc223b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:40.497901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473282d0-51fc-401b-b71f-012cdedc223b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:40.498177 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473282d0-51fc-401b-b71f-012cdedc223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:40.570403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-473282d0-51fc-401b-b71f-012cdedc223b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:40.576335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-473282d0-51fc-401b-b71f-012cdedc223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:40.601123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 660/1339] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:40.605141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473282d0-51fc-401b-b71f-012cdedc223b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:40.640060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473282d0-51fc-401b-b71f-012cdedc223b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:40.658473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:40.661976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:40.661976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:40.663831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:40.666998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:40.667315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:40.681822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:40.694892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c8ecad976043d1bdfc84a332b37538'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.725774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 661/1340] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:40.728488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:40.755398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c849e-45d4-400b-888e-9f2349888fcc admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:40.758341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c8ecad976043d1bdfc84a332b37538'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.759971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c8ecad976043d1bdfc84a332b37538'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.768143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0c3f4-69ff-42a9-baf6-524733bc66fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:40.769113 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c3f4-69ff-42a9-baf6-524733bc66fb admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:40.770117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c3f4-69ff-42a9-baf6-524733bc66fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:40.771178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c3f4-69ff-42a9-baf6-524733bc66fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:40.772336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0c3f4-69ff-42a9-baf6-524733bc66fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:40.783152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c8ecad976043d1bdfc84a332b37538'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.784155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0c3f4-69ff-42a9-baf6-524733bc66fb admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:40.784630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c8ecad976043d1bdfc84a332b37538'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:40.792197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:40.826133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 680/1341] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:40 2022] DELETE /identity/v3/users/44c8ecad976043d1bdfc84a332b37538 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:40.850291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 662/1342] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:40 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:40.854411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:40.856906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:41.072947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ede46d-6811-4cb3-8d4b-aee3813ba096 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:41.286177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68eb4-ec29-495b-afb7-b6c9f5debed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:41.299082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68eb4-ec29-495b-afb7-b6c9f5debed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:41.299396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68eb4-ec29-495b-afb7-b6c9f5debed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:41.304086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68eb4-ec29-495b-afb7-b6c9f5debed1 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:41.304865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be68eb4-ec29-495b-afb7-b6c9f5debed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:41.313317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be68eb4-ec29-495b-afb7-b6c9f5debed1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:41.369852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 681/1343] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:40 2022] POST /identity/v3/users => generated 303 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:41.374644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0c3f4-69ff-42a9-baf6-524733bc66fb admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:41.387804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0c3f4-69ff-42a9-baf6-524733bc66fb admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:41.410611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f2f2-4db0-4707-bdbd-03cea1f3588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:41.411248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f2f2-4db0-4707-bdbd-03cea1f3588f admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:41.411528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f2f2-4db0-4707-bdbd-03cea1f3588f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:41.411802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f2f2-4db0-4707-bdbd-03cea1f3588f admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:41.417632 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31f2f2-4db0-4707-bdbd-03cea1f3588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:41.423047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31f2f2-4db0-4707-bdbd-03cea1f3588f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:41.459598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 663/1344] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:41.463971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68eb4-ec29-495b-afb7-b6c9f5debed1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:41.493987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68eb4-ec29-495b-afb7-b6c9f5debed1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:41.507716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d2c73-bfa1-4c5e-b7da-f770d0ecf61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:41.509927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2c73-bfa1-4c5e-b7da-f770d0ecf61d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:41.510724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2c73-bfa1-4c5e-b7da-f770d0ecf61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:41.512078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2c73-bfa1-4c5e-b7da-f770d0ecf61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:41.516645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d2c73-bfa1-4c5e-b7da-f770d0ecf61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:41.521149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d2c73-bfa1-4c5e-b7da-f770d0ecf61d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:41.549756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 682/1345] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:41.550384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f2f2-4db0-4707-bdbd-03cea1f3588f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:41.563980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f2f2-4db0-4707-bdbd-03cea1f3588f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:41.585746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:41.586443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:41.586712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:41.586989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] PATH_INFO: `/v3/projects/672235a169ac4ab9ba8f1123e56437d8/users/793c05aef62741ce889028d7161f1ada/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:41.624676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672235a169ac4ab9ba8f1123e56437d8, user_id=793c05aef62741ce889028d7161f1ada, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:41.627572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:41.657646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 664/1346] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:41 2022] PUT /identity/v3/projects/672235a169ac4ab9ba8f1123e56437d8/users/793c05aef62741ce889028d7161f1ada/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:41.662861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4009a5-5a8f-4fb8-8e59-f625853a6c3e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:41.663278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4009a5-5a8f-4fb8-8e59-f625853a6c3e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:41.664001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4009a5-5a8f-4fb8-8e59-f625853a6c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:41.703195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2e4009a5-5a8f-4fb8-8e59-f625853a6c3e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:41.711876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2e4009a5-5a8f-4fb8-8e59-f625853a6c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:41.865116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 683/1347] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:41.911659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:41.912294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:42.098462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adff8e-2d21-4104-90e7-4e40fe436327 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:42.110769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e9c0-35d6-4bd8-ba8a-82c5e88a87dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:42.117274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e9c0-35d6-4bd8-ba8a-82c5e88a87dc service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:42.117753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e9c0-35d6-4bd8-ba8a-82c5e88a87dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:42.118194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e9c0-35d6-4bd8-ba8a-82c5e88a87dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:42.155918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40e9c0-35d6-4bd8-ba8a-82c5e88a87dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:42.157388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40e9c0-35d6-4bd8-ba8a-82c5e88a87dc service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:42.178426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 665/1348] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:43.177568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4009a5-5a8f-4fb8-8e59-f625853a6c3e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:43.180462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2e4009a5-5a8f-4fb8-8e59-f625853a6c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:43.203622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4009a5-5a8f-4fb8-8e59-f625853a6c3e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:43.218549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:43.219688 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:43.220171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:43.220672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] PATH_INFO: `/v3/projects/29b7dcecd1a04c7f81adb42baabb8d5b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:43.222752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b7dcecd1a04c7f81adb42baabb8d5b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:43.229939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:43.273646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:43.381898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b7dcecd1a04c7f81adb42baabb8d5b', 'request_id': 'req-96ff5628-7c63-49de-88b9-a6796c912b28'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:43.389911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b7dcecd1a04c7f81adb42baabb8d5b', 'request_id': 'req-96ff5628-7c63-49de-88b9-a6796c912b28'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:43.400659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b7dcecd1a04c7f81adb42baabb8d5b', 'request_id': 'req-96ff5628-7c63-49de-88b9-a6796c912b28'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:43.429931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] The token cache is being invalidate because project 29b7dcecd1a04c7f81adb42baabb8d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 12:59:43.430228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:43.432379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96ff5628-7c63-49de-88b9-a6796c912b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:43.440429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 684/1349] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 12:59:43 2022] DELETE /identity/v3/projects/29b7dcecd1a04c7f81adb42baabb8d5b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:43.442640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8fffb-6f71-4723-a05f-ad102dbd401d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:43.443082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8fffb-6f71-4723-a05f-ad102dbd401d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:43.443188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8fffb-6f71-4723-a05f-ad102dbd401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:43.482992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:43.499641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-84e8fffb-6f71-4723-a05f-ad102dbd401d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:43.500885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-84e8fffb-6f71-4723-a05f-ad102dbd401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:43.681960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 666/1350] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:43.691227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01436dc-3b7c-42e4-b163-a9a4c2310b1b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:43.691536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01436dc-3b7c-42e4-b163-a9a4c2310b1b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:43.692579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01436dc-3b7c-42e4-b163-a9a4c2310b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:43.748111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b01436dc-3b7c-42e4-b163-a9a4c2310b1b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:43.749398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b01436dc-3b7c-42e4-b163-a9a4c2310b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:43.793507 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 685/1351] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:43.796050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8fffb-6f71-4723-a05f-ad102dbd401d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:43.810094 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8fffb-6f71-4723-a05f-ad102dbd401d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:43.829938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:43.830933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:43.831368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:43.831801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:43.832660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:59:43.833146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:43.836252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:43.868354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 667/1352] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:59:43.873225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01436dc-3b7c-42e4-b163-a9a4c2310b1b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:43.883808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01436dc-3b7c-42e4-b163-a9a4c2310b1b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:43.901414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f8de0-f631-43a5-907c-7ce3d9b3e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:43.902229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f8de0-f631-43a5-907c-7ce3d9b3e970 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:43.903199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f8de0-f631-43a5-907c-7ce3d9b3e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:43.903475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f8de0-f631-43a5-907c-7ce3d9b3e970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:43.904119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f8de0-f631-43a5-907c-7ce3d9b3e970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:43.906124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f8de0-f631-43a5-907c-7ce3d9b3e970 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:43.946919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 686/1353] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:43 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:43.951264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:43.964273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e900a-17bc-442b-a68a-1035f50566f2 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:44.091581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad486db-d373-4e33-a18c-3a1e4f5eba16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:44.092563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad486db-d373-4e33-a18c-3a1e4f5eba16 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:44.094664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad486db-d373-4e33-a18c-3a1e4f5eba16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:44.095251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad486db-d373-4e33-a18c-3a1e4f5eba16 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:44.096853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad486db-d373-4e33-a18c-3a1e4f5eba16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:44.104271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad486db-d373-4e33-a18c-3a1e4f5eba16 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:44.149876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 668/1354] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:43 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:59:44.151713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f8de0-f631-43a5-907c-7ce3d9b3e970 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:44.168745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f8de0-f631-43a5-907c-7ce3d9b3e970 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:44.179407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909eea1-31c2-4e2b-93b1-a64f3017b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:44.181014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909eea1-31c2-4e2b-93b1-a64f3017b067 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:44.181402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909eea1-31c2-4e2b-93b1-a64f3017b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:44.181959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909eea1-31c2-4e2b-93b1-a64f3017b067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:44.182925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909eea1-31c2-4e2b-93b1-a64f3017b067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:44.185358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909eea1-31c2-4e2b-93b1-a64f3017b067 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:44.208146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 687/1355] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:44.209775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad486db-d373-4e33-a18c-3a1e4f5eba16 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:44.223255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad486db-d373-4e33-a18c-3a1e4f5eba16 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:44.229458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7644e0d-4113-4623-aeb5-f08e6621c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:44.230271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644e0d-4113-4623-aeb5-f08e6621c593 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:44.230668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644e0d-4113-4623-aeb5-f08e6621c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:44.231959 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644e0d-4113-4623-aeb5-f08e6621c593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:44.233049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7644e0d-4113-4623-aeb5-f08e6621c593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:44.235866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7644e0d-4113-4623-aeb5-f08e6621c593 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:44.285263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 669/1356] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:44.289440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909eea1-31c2-4e2b-93b1-a64f3017b067 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:44.308319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909eea1-31c2-4e2b-93b1-a64f3017b067 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:44.325524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a7149-6ff0-46c1-894b-84f3049c7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:44.327416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7149-6ff0-46c1-894b-84f3049c7062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:44.327706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7149-6ff0-46c1-894b-84f3049c7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:44.328949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a7149-6ff0-46c1-894b-84f3049c7062 admin admin] PATH_INFO: `/v3/projects/4e3522fbc9ba41f391ec7fd31f388079/users/9374974912684591a4c60e50688e2341/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:44.389983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a7149-6ff0-46c1-894b-84f3049c7062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3522fbc9ba41f391ec7fd31f388079, user_id=9374974912684591a4c60e50688e2341, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:44.410449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a7149-6ff0-46c1-894b-84f3049c7062 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:44.449955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 688/1357] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:44 2022] PUT /identity/v3/projects/4e3522fbc9ba41f391ec7fd31f388079/users/9374974912684591a4c60e50688e2341/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:44.464549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b5b8-ad53-4283-b044-7b51d723aed2 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:44.465736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b5b8-ad53-4283-b044-7b51d723aed2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:44.466207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b5b8-ad53-4283-b044-7b51d723aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:44.543635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0af8b5b8-ad53-4283-b044-7b51d723aed2 None None] MFA Rules not processed for user `9374974912684591a4c60e50688e2341`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:44.545532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0af8b5b8-ad53-4283-b044-7b51d723aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:44.693991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 670/1358] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:44.698079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a7149-6ff0-46c1-894b-84f3049c7062 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:44.881368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a7149-6ff0-46c1-894b-84f3049c7062 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:44.895404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf289e5-c564-45f4-9f81-7aeb0bf03da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:44.898991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf289e5-c564-45f4-9f81-7aeb0bf03da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:44.899141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf289e5-c564-45f4-9f81-7aeb0bf03da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:44.900069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf289e5-c564-45f4-9f81-7aeb0bf03da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:44.902739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf289e5-c564-45f4-9f81-7aeb0bf03da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:44.910218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf289e5-c564-45f4-9f81-7aeb0bf03da7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:44.969561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 689/1359] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:44 2022] POST /identity/v3/projects => generated 369 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:44.971297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b5b8-ad53-4283-b044-7b51d723aed2 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:44.989579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:45.001604 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b5b8-ad53-4283-b044-7b51d723aed2 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:45.128881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3eaef-89f2-4821-913b-ead2cd53763f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:45.130336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3eaef-89f2-4821-913b-ead2cd53763f admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:45.130721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3eaef-89f2-4821-913b-ead2cd53763f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:45.131092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3eaef-89f2-4821-913b-ead2cd53763f admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:45.131988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3eaef-89f2-4821-913b-ead2cd53763f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:45.136157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3eaef-89f2-4821-913b-ead2cd53763f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:45.202041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 671/1360] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:44 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:45.203771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf289e5-c564-45f4-9f81-7aeb0bf03da7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:45.219093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf289e5-c564-45f4-9f81-7aeb0bf03da7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:45.233781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89e8e-a0e6-4a60-a015-dd4942326044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:45.234748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89e8e-a0e6-4a60-a015-dd4942326044 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:45.235147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89e8e-a0e6-4a60-a015-dd4942326044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:45.235518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d89e8e-a0e6-4a60-a015-dd4942326044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:45.237198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d89e8e-a0e6-4a60-a015-dd4942326044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:45.239042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d89e8e-a0e6-4a60-a015-dd4942326044 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:45.257783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 690/1361] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:45.259462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3eaef-89f2-4821-913b-ead2cd53763f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:45.276914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3eaef-89f2-4821-913b-ead2cd53763f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:45.296725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fec02-6a2e-4de0-af0b-4a1c97746648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:45.297973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fec02-6a2e-4de0-af0b-4a1c97746648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:45.298357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fec02-6a2e-4de0-af0b-4a1c97746648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:45.298774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fec02-6a2e-4de0-af0b-4a1c97746648 admin admin] PATH_INFO: `/v3/projects/9a41264f9f7f4976a76387c91f144934/users/5b37614e86b64c06bac0a25f5ec5f921/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:45.330814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fec02-6a2e-4de0-af0b-4a1c97746648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a41264f9f7f4976a76387c91f144934, user_id=5b37614e86b64c06bac0a25f5ec5f921, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:45.334344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fec02-6a2e-4de0-af0b-4a1c97746648 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:45.366485 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 672/1362] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:45 2022] PUT /identity/v3/projects/9a41264f9f7f4976a76387c91f144934/users/5b37614e86b64c06bac0a25f5ec5f921/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:45.371916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89e8e-a0e6-4a60-a015-dd4942326044 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:45.406645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d89e8e-a0e6-4a60-a015-dd4942326044 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:45.423947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:45.584388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666713a6-8639-462b-bd34-78e2d844f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:45.585347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666713a6-8639-462b-bd34-78e2d844f39c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:45.586071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666713a6-8639-462b-bd34-78e2d844f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:45.586576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666713a6-8639-462b-bd34-78e2d844f39c admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:45.587435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666713a6-8639-462b-bd34-78e2d844f39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:45.593780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666713a6-8639-462b-bd34-78e2d844f39c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:45.633429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 691/1363] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:45.637328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fec02-6a2e-4de0-af0b-4a1c97746648 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:45.661165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fec02-6a2e-4de0-af0b-4a1c97746648 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:45.673407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6c2b8-d704-4c6b-a841-6d7a62dccca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:45.674228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c2b8-d704-4c6b-a841-6d7a62dccca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:45.674643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c2b8-d704-4c6b-a841-6d7a62dccca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:45.675036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6c2b8-d704-4c6b-a841-6d7a62dccca0 admin admin] PATH_INFO: `/v3/projects/9a41264f9f7f4976a76387c91f144934/users/5b37614e86b64c06bac0a25f5ec5f921/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:45.677209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6c2b8-d704-4c6b-a841-6d7a62dccca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a41264f9f7f4976a76387c91f144934, user_id=5b37614e86b64c06bac0a25f5ec5f921, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:45.681081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6c2b8-d704-4c6b-a841-6d7a62dccca0 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:45.698054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 673/1364] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:45 2022] PUT /identity/v3/projects/9a41264f9f7f4976a76387c91f144934/users/5b37614e86b64c06bac0a25f5ec5f921/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:45.709177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f0b09-d909-4fe4-aa5a-351ff26bb466 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:45.709671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f0b09-d909-4fe4-aa5a-351ff26bb466 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:45.710091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f0b09-d909-4fe4-aa5a-351ff26bb466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:46.085366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7de42-690c-4270-aa5b-2791a148d97f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:46.085906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7de42-690c-4270-aa5b-2791a148d97f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:46.086212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7de42-690c-4270-aa5b-2791a148d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:46.181942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-11b7de42-690c-4270-aa5b-2791a148d97f None None] MFA Rules not processed for user `60860294eb284b8aa11edd42dca4ae8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:46.183210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-11b7de42-690c-4270-aa5b-2791a148d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:46.210759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6c4f0b09-d909-4fe4-aa5a-351ff26bb466 None None] MFA Rules not processed for user `5b37614e86b64c06bac0a25f5ec5f921`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:46.214441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6c4f0b09-d909-4fe4-aa5a-351ff26bb466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:46.398580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 674/1365] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:46.406098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc666e-18a0-460a-93e8-c94fab45f259 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:46.406098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc666e-18a0-460a-93e8-c94fab45f259 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:46.406098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc666e-18a0-460a-93e8-c94fab45f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:46.458326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 692/1366] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 750 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:46.461954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e76cf-140a-4968-b9b4-fe915ea0c33a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:46.461954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e76cf-140a-4968-b9b4-fe915ea0c33a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:46.461954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e76cf-140a-4968-b9b4-fe915ea0c33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:46.491827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-20fc666e-18a0-460a-93e8-c94fab45f259 None None] MFA Rules not processed for user `793c05aef62741ce889028d7161f1ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:46.498302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-20fc666e-18a0-460a-93e8-c94fab45f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:46.537771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-181e76cf-140a-4968-b9b4-fe915ea0c33a None None] MFA Rules not processed for user `60860294eb284b8aa11edd42dca4ae8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:46.539124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-181e76cf-140a-4968-b9b4-fe915ea0c33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:46.562412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 693/1367] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:46.563289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e76cf-140a-4968-b9b4-fe915ea0c33a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:46.566133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-181e76cf-140a-4968-b9b4-fe915ea0c33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:46.642995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:46.735415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 675/1368] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:46.737227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc666e-18a0-460a-93e8-c94fab45f259 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:46.741837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-20fc666e-18a0-460a-93e8-c94fab45f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:46.754742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e76cf-140a-4968-b9b4-fe915ea0c33a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:46.763494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:46.764052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:46.764338 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:46.764607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:46.783379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:46.784900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:46.829550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 694/1369] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:46.830412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:46.838694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:46.969823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:46.998748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc666e-18a0-460a-93e8-c94fab45f259 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:47.015037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fc6be-c10c-4892-aad3-9ec747f3eb5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:47.015677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc6be-c10c-4892-aad3-9ec747f3eb5b service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.015956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc6be-c10c-4892-aad3-9ec747f3eb5b service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.016227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fc6be-c10c-4892-aad3-9ec747f3eb5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.034435 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fc6be-c10c-4892-aad3-9ec747f3eb5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:47.038993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fc6be-c10c-4892-aad3-9ec747f3eb5b service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:47.062353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 676/1370] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:47.101087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3b1f1-8998-42b2-9705-f00d6d940cf8 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:47.109407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad61d4-1cae-4290-b310-082e2afaf06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:47.112970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad61d4-1cae-4290-b310-082e2afaf06c admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.113373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad61d4-1cae-4290-b310-082e2afaf06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.113988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad61d4-1cae-4290-b310-082e2afaf06c admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.116041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad61d4-1cae-4290-b310-082e2afaf06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:47.126303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad61d4-1cae-4290-b310-082e2afaf06c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:47.189873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 695/1371] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 12:59:46 2022] POST /identity/v3/projects => generated 405 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:47.194027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fc6be-c10c-4892-aad3-9ec747f3eb5b service nova] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:47.219008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fc6be-c10c-4892-aad3-9ec747f3eb5b service nova] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:47.359452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e7c0b-d045-42d9-a208-17730b5ca3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:47.360153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e7c0b-d045-42d9-a208-17730b5ca3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.360501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e7c0b-d045-42d9-a208-17730b5ca3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.360845 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e7c0b-d045-42d9-a208-17730b5ca3ab admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.361605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e7c0b-d045-42d9-a208-17730b5ca3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:47.365114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e7c0b-d045-42d9-a208-17730b5ca3ab admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:47.402315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 677/1372] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 12:59:47 2022] POST /identity/v3/users => generated 309 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:59:47.406838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad61d4-1cae-4290-b310-082e2afaf06c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:47.427231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad61d4-1cae-4290-b310-082e2afaf06c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:47.455969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d02b-691f-4e22-aeb4-3b232158e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:47.460369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d02b-691f-4e22-aeb4-3b232158e6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.461134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d02b-691f-4e22-aeb4-3b232158e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.461759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d02b-691f-4e22-aeb4-3b232158e6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.462838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d02b-691f-4e22-aeb4-3b232158e6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:47.467411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d02b-691f-4e22-aeb4-3b232158e6ec admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:47.507284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 696/1373] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:47.508505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e7c0b-d045-42d9-a208-17730b5ca3ab admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:47.522820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e7c0b-d045-42d9-a208-17730b5ca3ab admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:47.540424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c110a-f935-4ebe-a375-c841b107739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:47.541058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c110a-f935-4ebe-a375-c841b107739b admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.541335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c110a-f935-4ebe-a375-c841b107739b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.541700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c110a-f935-4ebe-a375-c841b107739b admin admin] PATH_INFO: `/v3/projects/a3b683ba271545c1b105b6381f485351/users/e1e1a399b5fc422b914688cfa2b3dd68/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.582448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c110a-f935-4ebe-a375-c841b107739b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b683ba271545c1b105b6381f485351, user_id=e1e1a399b5fc422b914688cfa2b3dd68, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:47.586906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c110a-f935-4ebe-a375-c841b107739b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:47.626554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 678/1374] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:47 2022] PUT /identity/v3/projects/a3b683ba271545c1b105b6381f485351/users/e1e1a399b5fc422b914688cfa2b3dd68/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:47.630533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d02b-691f-4e22-aeb4-3b232158e6ec admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:47.657219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d02b-691f-4e22-aeb4-3b232158e6ec admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:47.829229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa918-9920-4115-b2b1-481ec20d7eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:47.830204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa918-9920-4115-b2b1-481ec20d7eba admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.832384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa918-9920-4115-b2b1-481ec20d7eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.832384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa918-9920-4115-b2b1-481ec20d7eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.836535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aa918-9920-4115-b2b1-481ec20d7eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:47.839010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aa918-9920-4115-b2b1-481ec20d7eba admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:47.872560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea0ae-6f44-4113-8638-1886bf6c338c None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.873913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea0ae-6f44-4113-8638-1886bf6c338c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.874446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ea0ae-6f44-4113-8638-1886bf6c338c None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.876153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 679/1375] 10.222.0.47 () {54 vars in 912 bytes} [Fri Oct 14 12:59:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:59:47.883318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 697/1376] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 12:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:59:47.888041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ea0ae-6f44-4113-8638-1886bf6c338c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:47.898314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c9a4a-0f42-403d-90e9-589630051a67 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.900261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c9a4a-0f42-403d-90e9-589630051a67 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.900653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c9a4a-0f42-403d-90e9-589630051a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.918322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ea0ae-6f44-4113-8638-1886bf6c338c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:47.933896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:47.945431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:47.945737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:47.946013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] PATH_INFO: `/v3/projects/a3b683ba271545c1b105b6381f485351/users/e1e1a399b5fc422b914688cfa2b3dd68/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:47.961288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b683ba271545c1b105b6381f485351, user_id=e1e1a399b5fc422b914688cfa2b3dd68, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:47.981297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:48.017620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-840c9a4a-0f42-403d-90e9-589630051a67 None None] MFA Rules not processed for user `899319384b8b471f8d308f37be459c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:48.018975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-840c9a4a-0f42-403d-90e9-589630051a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:48.028448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 680/1377] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 12:59:47 2022] PUT /identity/v3/projects/a3b683ba271545c1b105b6381f485351/users/e1e1a399b5fc422b914688cfa2b3dd68/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:59:48.099953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 698/1378] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:48.177205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:48.179826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:48.208478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec840af-da44-4762-930b-6319aee2f17e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:48.227973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:48.231198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:48.231763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:48.236454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:48.274562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:48.281336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:48.285229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:48.308081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 681/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:49.305930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aed28-6607-4b07-a21b-54144f111081 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:49.306408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aed28-6607-4b07-a21b-54144f111081 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:49.306513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aed28-6607-4b07-a21b-54144f111081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:49.430432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-303aed28-6607-4b07-a21b-54144f111081 None None] MFA Rules not processed for user `0bcbf6513b6a4df3b044fadfb7888d54`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:49.431707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-303aed28-6607-4b07-a21b-54144f111081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:49.528234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:49.657217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 699/1380] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:49.670900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:49.674715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:49.900789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aed28-6607-4b07-a21b-54144f111081 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:49.902602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-303aed28-6607-4b07-a21b-54144f111081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:49.959554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58f58-1d95-4886-849c-c2309f32d89a service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:49.966086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde7e84-bb07-449f-8ca0-c07ebefb4dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:49.967332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde7e84-bb07-449f-8ca0-c07ebefb4dd3 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:49.967858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde7e84-bb07-449f-8ca0-c07ebefb4dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:49.968526 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde7e84-bb07-449f-8ca0-c07ebefb4dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:50.026959 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde7e84-bb07-449f-8ca0-c07ebefb4dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:50.029096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde7e84-bb07-449f-8ca0-c07ebefb4dd3 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:50.040522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 682/1381] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:59:50.103622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aed28-6607-4b07-a21b-54144f111081 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:50.131640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:50.132611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:50.132940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:50.133210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] PATH_INFO: `/v3/users/edd93bdc7a804b399b976baf88c45164` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:50.141763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd93bdc7a804b399b976baf88c45164)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:50.144679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:50.324640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd93bdc7a804b399b976baf88c45164'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:50.335387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624860d-20fb-407f-bd51-b2a8cfba9aa6 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:50.335673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624860d-20fb-407f-bd51-b2a8cfba9aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:50.335942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624860d-20fb-407f-bd51-b2a8cfba9aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:50.351081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd93bdc7a804b399b976baf88c45164'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:50.352222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd93bdc7a804b399b976baf88c45164'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:50.383984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8624860d-20fb-407f-bd51-b2a8cfba9aa6 None None] MFA Rules not processed for user `4a23786597854812a0931f8622ce38c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:50.384672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd93bdc7a804b399b976baf88c45164'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:50.386472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f84ae76c-b493-43e4-9bf1-39251e12809f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd93bdc7a804b399b976baf88c45164'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:50.387998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8624860d-20fb-407f-bd51-b2a8cfba9aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:50.450143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 700/1382] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:49 2022] DELETE /identity/v3/users/edd93bdc7a804b399b976baf88c45164 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:59:50.451601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d282c-fada-4a87-8f05-439053f04039 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:50.451896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d282c-fada-4a87-8f05-439053f04039 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:50.452170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d282c-fada-4a87-8f05-439053f04039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:50.531651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e07d282c-fada-4a87-8f05-439053f04039 None None] MFA Rules not processed for user `e1e1a399b5fc422b914688cfa2b3dd68`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:50.535499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e07d282c-fada-4a87-8f05-439053f04039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:50.558269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 683/1383] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:59:50.558269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f2d4-e684-4e0f-893b-8402e76bcf7b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:50.558269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f2d4-e684-4e0f-893b-8402e76bcf7b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:50.558269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f2d4-e684-4e0f-893b-8402e76bcf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:50.662225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-06b6f2d4-e684-4e0f-893b-8402e76bcf7b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:50.663542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-06b6f2d4-e684-4e0f-893b-8402e76bcf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:50.666132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:50.826734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 701/1384] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:50.831267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfd88-685c-48a5-a622-074ba4268bd9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:50.831528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfd88-685c-48a5-a622-074ba4268bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:50.831798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bfd88-685c-48a5-a622-074ba4268bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:50.901035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fb2bfd88-685c-48a5-a622-074ba4268bd9 None None] MFA Rules not processed for user `4a23786597854812a0931f8622ce38c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:50.904534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fb2bfd88-685c-48a5-a622-074ba4268bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:50.925229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 684/1385] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:50.931112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cbbdc-8c36-4520-9db8-8e3ddf5b8531 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:50.931112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cbbdc-8c36-4520-9db8-8e3ddf5b8531 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:50.931316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cbbdc-8c36-4520-9db8-8e3ddf5b8531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:51.020727 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:51.035249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9c7cbbdc-8c36-4520-9db8-8e3ddf5b8531 None None] MFA Rules not processed for user `9394667740f44bcab24ee484b195fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:51.042369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9c7cbbdc-8c36-4520-9db8-8e3ddf5b8531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.052333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 702/1386] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:51.056328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bfd88-685c-48a5-a622-074ba4268bd9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:51.058948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fb2bfd88-685c-48a5-a622-074ba4268bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.220770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 685/1387] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:51.226759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cbbdc-8c36-4520-9db8-8e3ddf5b8531 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:51.228622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9c7cbbdc-8c36-4520-9db8-8e3ddf5b8531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.237249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bfd88-685c-48a5-a622-074ba4268bd9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:51.242900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:51.243728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:51.244107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:51.244494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:51.247785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.263894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:51.265074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cbbdc-8c36-4520-9db8-8e3ddf5b8531 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:51.266436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:51.274143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:51.275033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:51.276142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:51.276564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] PATH_INFO: `/v3/users/9374974912684591a4c60e50688e2341` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:51.278181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9374974912684591a4c60e50688e2341)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:51.280716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:51.288830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 703/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:51.292448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:51.294722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.363048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9374974912684591a4c60e50688e2341'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:51.393957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9374974912684591a4c60e50688e2341'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:51.397940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9374974912684591a4c60e50688e2341'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:51.412119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432c234-31d3-4de0-aee0-0e6a3fd77542 service placement] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:51.412687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9374974912684591a4c60e50688e2341'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:51.413660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-082ef0a1-812b-4ae7-8fa7-d1b714a085ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9374974912684591a4c60e50688e2341'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:51.426892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:51.427583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:51.427864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:51.428135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:51.434892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.443350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 686/1389] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:51 2022] DELETE /identity/v3/users/9374974912684591a4c60e50688e2341 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:51.449857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c22f3-7e4f-42c2-80e8-28c0e0058f1e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:51.453370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c22f3-7e4f-42c2-80e8-28c0e0058f1e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:51.453824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c22f3-7e4f-42c2-80e8-28c0e0058f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:51.465113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:51.466639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:51.483473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2e2c22f3-7e4f-42c2-80e8-28c0e0058f1e None None] MFA Rules not processed for user `60860294eb284b8aa11edd42dca4ae8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:51.491584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 704/1390] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:51.493667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:51.494251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2e2c22f3-7e4f-42c2-80e8-28c0e0058f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.497614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.533982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:51.615969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 687/1391] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:51.617001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c22f3-7e4f-42c2-80e8-28c0e0058f1e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:51.619166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2e2c22f3-7e4f-42c2-80e8-28c0e0058f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.678832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:51.717794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aef3c6-71da-4905-a778-73350090f073 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:51.786613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c22f3-7e4f-42c2-80e8-28c0e0058f1e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:51.795810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696d5e-3ddc-4aba-860c-84378040b38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:51.796647 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696d5e-3ddc-4aba-860c-84378040b38b service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:51.797073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696d5e-3ddc-4aba-860c-84378040b38b service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:51.797507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696d5e-3ddc-4aba-860c-84378040b38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:51.799752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bd696d5e-3ddc-4aba-860c-84378040b38b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.864954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:51.865712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:51.866052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:51.866385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:51.868382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:51.980973 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd696d5e-3ddc-4aba-860c-84378040b38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:51.982713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd696d5e-3ddc-4aba-860c-84378040b38b service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:52.009421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 688/1392] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:52.010753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e1f9-5423-4fa0-908c-e6470d2ccd25 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:52.011031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e1f9-5423-4fa0-908c-e6470d2ccd25 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:52.011339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e1f9-5423-4fa0-908c-e6470d2ccd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:52.070974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ac45e1f9-5423-4fa0-908c-e6470d2ccd25 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:52.072217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ac45e1f9-5423-4fa0-908c-e6470d2ccd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:52.087355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:52.089211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:52.135184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 705/1393] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:52.281340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 689/1394] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:52.328899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:52.331432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:52.463867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:52.504048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75559c9-3483-493b-a89d-267e3970f362 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:52.520619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9508942-1e9d-4ec5-9a14-a76c0aaa1564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:52.521951 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508942-1e9d-4ec5-9a14-a76c0aaa1564 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:52.524139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508942-1e9d-4ec5-9a14-a76c0aaa1564 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:52.525502 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508942-1e9d-4ec5-9a14-a76c0aaa1564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:52.553885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9508942-1e9d-4ec5-9a14-a76c0aaa1564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:52.555733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9508942-1e9d-4ec5-9a14-a76c0aaa1564 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:52.582229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 706/1395] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:53.146619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97604634-69c2-4ccf-bc26-dd37b25c3eb6 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:53.147243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97604634-69c2-4ccf-bc26-dd37b25c3eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:53.147614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97604634-69c2-4ccf-bc26-dd37b25c3eb6 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:53.151291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 690/1396] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 12:59:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:53.187177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427de32-489f-4203-a8ea-0aeff0cecc95 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:53.187748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427de32-489f-4203-a8ea-0aeff0cecc95 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:53.188426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427de32-489f-4203-a8ea-0aeff0cecc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:53.237474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d427de32-489f-4203-a8ea-0aeff0cecc95 None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:53.239567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d427de32-489f-4203-a8ea-0aeff0cecc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:53.374106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 707/1397] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:53.423162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97604634-69c2-4ccf-bc26-dd37b25c3eb6 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:53.424972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-97604634-69c2-4ccf-bc26-dd37b25c3eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:53.456491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97604634-69c2-4ccf-bc26-dd37b25c3eb6 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:53.469117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce38cf-c590-4ca8-8217-22ca99d08167 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:53.469761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce38cf-c590-4ca8-8217-22ca99d08167 service placement] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:53.470037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce38cf-c590-4ca8-8217-22ca99d08167 service placement] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:53.470307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce38cf-c590-4ca8-8217-22ca99d08167 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:53.493827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce38cf-c590-4ca8-8217-22ca99d08167 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:53.497680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce38cf-c590-4ca8-8217-22ca99d08167 service placement] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:53.521371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 691/1398] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:53.608210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427de32-489f-4203-a8ea-0aeff0cecc95 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:53.610521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d427de32-489f-4203-a8ea-0aeff0cecc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:53.637856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427de32-489f-4203-a8ea-0aeff0cecc95 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:53.662237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:53.663261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:53.664409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:53.669640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] PATH_INFO: `/v3/projects/61022b5907954d90b88dade684aa27ab` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:53.671334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=61022b5907954d90b88dade684aa27ab)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:53.675808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:53.803750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61022b5907954d90b88dade684aa27ab', 'request_id': 'req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:53.819145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61022b5907954d90b88dade684aa27ab', 'request_id': 'req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:53.835326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61022b5907954d90b88dade684aa27ab', 'request_id': 'req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:53.863000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] The token cache is being invalidate because project 61022b5907954d90b88dade684aa27ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 12:59:53.863323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:53.865363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e4ff1e6-a4ea-4765-bd53-307e4c97ec9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:53.871656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 708/1399] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 12:59:53 2022] DELETE /identity/v3/projects/61022b5907954d90b88dade684aa27ab => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:53.872916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce38cf-c590-4ca8-8217-22ca99d08167 service placement] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:53.888987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce38cf-c590-4ca8-8217-22ca99d08167 service placement] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:54.013504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:54.066701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:54.068933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:54.072948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:54.072948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] PATH_INFO: `/v3/users/ad0c75bedca0453bb4ad38da2fab7f44` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:54.078107 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0c75bedca0453bb4ad38da2fab7f44)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:54.090100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:54.270455 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0c75bedca0453bb4ad38da2fab7f44'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:54.338604 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0c75bedca0453bb4ad38da2fab7f44'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:54.343230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0c75bedca0453bb4ad38da2fab7f44'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:54.364702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0c75bedca0453bb4ad38da2fab7f44'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:54.365347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-485f90f8-bbca-4c7e-bdf4-cff53036eb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0c75bedca0453bb4ad38da2fab7f44'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:54.395262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 692/1400] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:53 2022] DELETE /identity/v3/users/ad0c75bedca0453bb4ad38da2fab7f44 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:54.836748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f327-b036-4651-ac01-f24c180359bd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:54.838286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f327-b036-4651-ac01-f24c180359bd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:54.838572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f327-b036-4651-ac01-f24c180359bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:54.994126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-df90f327-b036-4651-ac01-f24c180359bd None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:54.995374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-df90f327-b036-4651-ac01-f24c180359bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:55.087286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:55.172654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 709/1401] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 12:59:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:55.318821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555c44-768e-4431-9221-18c1dc51c7ff None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:55.319369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555c44-768e-4431-9221-18c1dc51c7ff None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:55.319369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91555c44-768e-4431-9221-18c1dc51c7ff None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:55.321151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 693/1402] 10.222.0.47 () {54 vars in 912 bytes} [Fri Oct 14 12:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:55.327888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb890-795c-42e8-9893-e8631d4b6b24 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:55.328388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb890-795c-42e8-9893-e8631d4b6b24 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:55.328971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdb890-795c-42e8-9893-e8631d4b6b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:55.379193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-20fdb890-795c-42e8-9893-e8631d4b6b24 None None] MFA Rules not processed for user `899319384b8b471f8d308f37be459c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:55.380911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-20fdb890-795c-42e8-9893-e8631d4b6b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:55.406701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91555c44-768e-4431-9221-18c1dc51c7ff None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:55.409103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-91555c44-768e-4431-9221-18c1dc51c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:55.512241 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 710/1403] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:55.640302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91555c44-768e-4431-9221-18c1dc51c7ff None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:55.646966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:55.648549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:55.648549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:55.648917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:55.660448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:55.662309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:55.674198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 694/1404] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 12:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 12:59:56.271483 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5eba-4ef6-45a9-9bab-3dbfe1133dc9 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:56.272070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5eba-4ef6-45a9-9bab-3dbfe1133dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:56.272442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5eba-4ef6-45a9-9bab-3dbfe1133dc9 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:56.276388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:56.279065 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:56.283047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 711/1405] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 12:59:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:56.311937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8556728-2cb4-4a66-ab99-4ceef710039f service swift] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:56.351073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a70212-f549-4bc2-8fe0-4e2a5096b4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:56.353558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a70212-f549-4bc2-8fe0-4e2a5096b4ab service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:56.354745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a70212-f549-4bc2-8fe0-4e2a5096b4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:56.355424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a70212-f549-4bc2-8fe0-4e2a5096b4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:56.355931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc5eba-4ef6-45a9-9bab-3dbfe1133dc9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:56.358057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c6cc5eba-4ef6-45a9-9bab-3dbfe1133dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:56.376538 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a70212-f549-4bc2-8fe0-4e2a5096b4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:56.378380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a70212-f549-4bc2-8fe0-4e2a5096b4ab service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:56.407559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 695/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:56.411381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc71d-ef13-44d9-9b20-d860725e3fe3 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:56.412924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc71d-ef13-44d9-9b20-d860725e3fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:56.413414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc71d-ef13-44d9-9b20-d860725e3fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:56.459385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-460dc71d-ef13-44d9-9b20-d860725e3fe3 None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:56.462529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-460dc71d-ef13-44d9-9b20-d860725e3fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:56.566235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:56.751629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 696/1407] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:56.767644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc5eba-4ef6-45a9-9bab-3dbfe1133dc9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:56.790721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:56.791394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:56.801822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:56.802306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] PATH_INFO: `/v3/users/793c05aef62741ce889028d7161f1ada` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:56.804701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=793c05aef62741ce889028d7161f1ada)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:56.807338 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:56.820004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65961-d9ad-488f-81a4-c398be7212bc None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:56.820516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65961-d9ad-488f-81a4-c398be7212bc None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:56.820949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf65961-d9ad-488f-81a4-c398be7212bc None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:56.822830 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 697/1408] 10.222.0.47 () {54 vars in 961 bytes} [Fri Oct 14 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:56.831178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9661-28bc-41db-8152-ae81aade40fc None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:56.831454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9661-28bc-41db-8152-ae81aade40fc None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:56.831646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9661-28bc-41db-8152-ae81aade40fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:56.917094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793c05aef62741ce889028d7161f1ada'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:56.944185 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793c05aef62741ce889028d7161f1ada'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:56.952221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793c05aef62741ce889028d7161f1ada'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:56.964092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793c05aef62741ce889028d7161f1ada'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:56.964887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793c05aef62741ce889028d7161f1ada'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:57.018079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 712/1409] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:56 2022] DELETE /identity/v3/users/793c05aef62741ce889028d7161f1ada => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:57.033326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-497d9661-28bc-41db-8152-ae81aade40fc None None] MFA Rules not processed for user `b4a7dff4f94f4b28ab8e5ae9b7d9aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:57.042014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-497d9661-28bc-41db-8152-ae81aade40fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:57.231918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 698/1410] 10.222.0.47 () {58 vars in 1058 bytes} [Fri Oct 14 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:57.232448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:57.238095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d9661-28bc-41db-8152-ae81aade40fc None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:57.240610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-497d9661-28bc-41db-8152-ae81aade40fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:57.244782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:57.263840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043592a0-732f-41d5-892a-f4656b0b3b15 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:57.288988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:57.298282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:57.299627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:57.301156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:57.310115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:57.390486 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:57.397346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:57.447147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d9661-28bc-41db-8152-ae81aade40fc None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:57.448809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 713/1411] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:59:57.483791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:57.484754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:57.485034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:57.485300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] PATH_INFO: `/v3/projects/4e3522fbc9ba41f391ec7fd31f388079` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:57.487693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3522fbc9ba41f391ec7fd31f388079)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:57.489775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:57.916729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3522fbc9ba41f391ec7fd31f388079', 'request_id': 'req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:57.938199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:57.942033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3522fbc9ba41f391ec7fd31f388079', 'request_id': 'req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:57.972701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3522fbc9ba41f391ec7fd31f388079', 'request_id': 'req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:58.035932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] The token cache is being invalidate because project 4e3522fbc9ba41f391ec7fd31f388079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 12:59:58.036366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:58.041934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0f8fb127-ccdb-4acb-bb9a-1c8d9dc2d7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:58.053564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 699/1412] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 12:59:57 2022] DELETE /identity/v3/projects/4e3522fbc9ba41f391ec7fd31f388079 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:58.053756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:58.056882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7de1-e05a-418b-9109-2cb7a4320fa5 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:58.057162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7de1-e05a-418b-9109-2cb7a4320fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:58.057437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7de1-e05a-418b-9109-2cb7a4320fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:58.083137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ba5c8-c1dd-4d9a-b150-0f6238bb9e06 service placement] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:58.162681 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-943c7de1-e05a-418b-9109-2cb7a4320fa5 None None] MFA Rules not processed for user `899319384b8b471f8d308f37be459c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:58.175106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-943c7de1-e05a-418b-9109-2cb7a4320fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:58.279064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:58.279991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:58.290221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:58.290909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] PATH_INFO: `/v3/users/5b37614e86b64c06bac0a25f5ec5f921` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:58.293059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b37614e86b64c06bac0a25f5ec5f921)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:58.295832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:58.480824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b37614e86b64c06bac0a25f5ec5f921'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:58.491742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 700/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Oct 14 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:59:58.536576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7de1-e05a-418b-9109-2cb7a4320fa5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:58.541534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-943c7de1-e05a-418b-9109-2cb7a4320fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:58.546399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b37614e86b64c06bac0a25f5ec5f921'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:58.550088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b37614e86b64c06bac0a25f5ec5f921'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:58.576883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b37614e86b64c06bac0a25f5ec5f921'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:58.580419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b37614e86b64c06bac0a25f5ec5f921'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:58.590079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7de1-e05a-418b-9109-2cb7a4320fa5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:58.642427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:58.643423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:58.643705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:58.643980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:58.653183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:58.662557 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 714/1414] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:58 2022] DELETE /identity/v3/users/5b37614e86b64c06bac0a25f5ec5f921 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:58.696644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:58.698040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:58.728246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 701/1415] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:58.757022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:58.758708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:59.062012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf7d9d-9236-4b5e-88a0-9cd9e3020af0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:59.079266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:59.080009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:59.080309 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:59.080591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] PATH_INFO: `/v3/projects/672235a169ac4ab9ba8f1123e56437d8` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:59.086356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672235a169ac4ab9ba8f1123e56437d8)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:59.088408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:59.169668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:59.324754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672235a169ac4ab9ba8f1123e56437d8', 'request_id': 'req-772692d1-1225-4919-92a9-de56a7eea222'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.346132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672235a169ac4ab9ba8f1123e56437d8', 'request_id': 'req-772692d1-1225-4919-92a9-de56a7eea222'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.373289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672235a169ac4ab9ba8f1123e56437d8', 'request_id': 'req-772692d1-1225-4919-92a9-de56a7eea222'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.408147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] The token cache is being invalidate because project 672235a169ac4ab9ba8f1123e56437d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 12:59:59.408147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.409157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.420985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 715/1416] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 12:59:58 2022] DELETE /identity/v3/projects/672235a169ac4ab9ba8f1123e56437d8 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:59:59.421337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:59.450047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124855d-be1c-4987-83fc-bb7e2c2dd9f0 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:59.624985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:59.626628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:59.627254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:59.627801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] PATH_INFO: `/v3/users/e1e1a399b5fc422b914688cfa2b3dd68` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:59.630277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e1a399b5fc422b914688cfa2b3dd68)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:59.640422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:59.803594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e1a399b5fc422b914688cfa2b3dd68'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.845318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e1a399b5fc422b914688cfa2b3dd68'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.848854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e1a399b5fc422b914688cfa2b3dd68'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.863828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e1a399b5fc422b914688cfa2b3dd68'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.864689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e1a399b5fc422b914688cfa2b3dd68'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:59:59.877833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:59.888651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 702/1417] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 12:59:59 2022] DELETE /identity/v3/users/e1e1a399b5fc422b914688cfa2b3dd68 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:00.658080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:00.665904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:00.699135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772692d1-1225-4919-92a9-de56a7eea222 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:00.840788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:00.841751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:00.842205 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:00.842614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] PATH_INFO: `/v3/users/e0cf023a86ba47e9a2bb86343a71c1c9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:00.844392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0cf023a86ba47e9a2bb86343a71c1c9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:00.847032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:00.962849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:00.966331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:00.994243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea0d0b-3a7d-4db6-b9e5-4fa9529af14d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:01.009648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:01.010601 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:01.011384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:01.012948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] PATH_INFO: `/v3/projects/9a41264f9f7f4976a76387c91f144934` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:01.013075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a41264f9f7f4976a76387c91f144934)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:01.015034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:01.056970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0cf023a86ba47e9a2bb86343a71c1c9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.084702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0cf023a86ba47e9a2bb86343a71c1c9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.085919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0cf023a86ba47e9a2bb86343a71c1c9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.096755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0cf023a86ba47e9a2bb86343a71c1c9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.097621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b7199655-b1a9-4493-af45-bad3e75e6d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0cf023a86ba47e9a2bb86343a71c1c9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.136608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 716/1418] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:00 2022] DELETE /identity/v3/users/e0cf023a86ba47e9a2bb86343a71c1c9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:01.156470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48666fa-3316-4a6b-ad51-f6d78dc1bf68 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:01.159209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48666fa-3316-4a6b-ad51-f6d78dc1bf68 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:01.159878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48666fa-3316-4a6b-ad51-f6d78dc1bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:01.160720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a41264f9f7f4976a76387c91f144934', 'request_id': 'req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.180085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a41264f9f7f4976a76387c91f144934', 'request_id': 'req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.214063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a41264f9f7f4976a76387c91f144934', 'request_id': 'req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.250334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d48666fa-3316-4a6b-ad51-f6d78dc1bf68 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:01.257878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d48666fa-3316-4a6b-ad51-f6d78dc1bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:01.260608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] The token cache is being invalidate because project 9a41264f9f7f4976a76387c91f144934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:01.263677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.265790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-9a266a17-a04c-4fb1-a8a0-a4d4e7f638a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:01.271078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 703/1419] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:00 2022] DELETE /identity/v3/projects/9a41264f9f7f4976a76387c91f144934 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:01.277076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767015b-3e1d-4661-843b-8a7608f45f3e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:01.279269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767015b-3e1d-4661-843b-8a7608f45f3e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:01.280733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767015b-3e1d-4661-843b-8a7608f45f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:01.299472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:01.328813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d767015b-3e1d-4661-843b-8a7608f45f3e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:01.332001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d767015b-3e1d-4661-843b-8a7608f45f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:01.403023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 717/1420] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:01.440816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48666fa-3316-4a6b-ad51-f6d78dc1bf68 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:01.443095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d48666fa-3316-4a6b-ad51-f6d78dc1bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:01.578169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 704/1421] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:01.582214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4ab3a-dbef-4d12-8d72-a143eebda7e6 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:01.582498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4ab3a-dbef-4d12-8d72-a143eebda7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:01.582828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4ab3a-dbef-4d12-8d72-a143eebda7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:01.644177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48666fa-3316-4a6b-ad51-f6d78dc1bf68 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:01.663596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d2e4ab3a-dbef-4d12-8d72-a143eebda7e6 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:01.666100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d2e4ab3a-dbef-4d12-8d72-a143eebda7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:01.672776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:01.673796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:01.674076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:01.674988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:01.704086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:01.705795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 705/1422] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:01.708521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:01.721899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4ab3a-dbef-4d12-8d72-a143eebda7e6 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:01.750866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4ab3a-dbef-4d12-8d72-a143eebda7e6 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:01.753098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 718/1423] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:01.766602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:01.767631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:01.768127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:01.769057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:01.771289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:01.772142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:01.774545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:01.814135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:01.822406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:01.857068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595be8-dd90-4340-aa0b-1e1ccb8c4b4d service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:01.857782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 706/1424] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:01.867680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:01.877920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:01.878733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:01.879123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:01.885408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] PATH_INFO: `/v3/projects/20a2e30e9d9d4426b6ebe83205fb212a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:01.887912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a2e30e9d9d4426b6ebe83205fb212a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:01.890853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:01.898255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc78f5-2e92-4ebc-ad58-c7aff15b18d5 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:01.914213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009a29-fa6a-4352-b398-79a9dd07d1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:01.915115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009a29-fa6a-4352-b398-79a9dd07d1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:01.915544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009a29-fa6a-4352-b398-79a9dd07d1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:01.916013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009a29-fa6a-4352-b398-79a9dd07d1b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:01.920732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009a29-fa6a-4352-b398-79a9dd07d1b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:01.924071 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009a29-fa6a-4352-b398-79a9dd07d1b7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:01.999637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 707/1425] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:01 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:02.001234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009a29-fa6a-4352-b398-79a9dd07d1b7 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:02.015734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a2e30e9d9d4426b6ebe83205fb212a', 'request_id': 'req-87cca48b-78cf-46e7-af6c-66f1b8865df7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.037868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a2e30e9d9d4426b6ebe83205fb212a', 'request_id': 'req-87cca48b-78cf-46e7-af6c-66f1b8865df7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.051966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a2e30e9d9d4426b6ebe83205fb212a', 'request_id': 'req-87cca48b-78cf-46e7-af6c-66f1b8865df7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.079073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] The token cache is being invalidate because project 20a2e30e9d9d4426b6ebe83205fb212a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:02.080649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.082957 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-87cca48b-78cf-46e7-af6c-66f1b8865df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.091781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 719/1426] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:01 2022] DELETE /identity/v3/projects/20a2e30e9d9d4426b6ebe83205fb212a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:02.094666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8f17-e870-43cd-80da-55a8db44a062 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.097275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8f17-e870-43cd-80da-55a8db44a062 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.099609 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8f17-e870-43cd-80da-55a8db44a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.115686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:02.147352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9eaf8f17-e870-43cd-80da-55a8db44a062 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:02.151390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9eaf8f17-e870-43cd-80da-55a8db44a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:02.197298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009a29-fa6a-4352-b398-79a9dd07d1b7 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:02.204487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:02.205334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.205875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.206465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.210352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:02.212545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:02.263849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 708/1427] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:02 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:02.265091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:02.267317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:02.300180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf6c38-24d3-4bec-92dd-3fc2d2adc93c admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:02.307748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c994-48e0-45aa-953e-58b198984ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:02.308924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c994-48e0-45aa-953e-58b198984ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.309192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c994-48e0-45aa-953e-58b198984ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.309465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c994-48e0-45aa-953e-58b198984ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.310179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9c994-48e0-45aa-953e-58b198984ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:02.311807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9c994-48e0-45aa-953e-58b198984ac3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:02.333534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:02.337630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 709/1428] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:02.338613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c994-48e0-45aa-953e-58b198984ac3 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:02.360769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c994-48e0-45aa-953e-58b198984ac3 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:02.384836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59def13d-5379-4f69-9ac0-c2f69dc6e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:02.385463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59def13d-5379-4f69-9ac0-c2f69dc6e287 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.385775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59def13d-5379-4f69-9ac0-c2f69dc6e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.386087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59def13d-5379-4f69-9ac0-c2f69dc6e287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.386745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59def13d-5379-4f69-9ac0-c2f69dc6e287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:02.388369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59def13d-5379-4f69-9ac0-c2f69dc6e287 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:02.395214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 720/1429] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:02.398819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87461a3-1340-4304-a9c6-552714cfcafd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.399110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87461a3-1340-4304-a9c6-552714cfcafd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.399388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87461a3-1340-4304-a9c6-552714cfcafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.426675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 710/1430] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:02.438603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59def13d-5379-4f69-9ac0-c2f69dc6e287 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:02.460584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f87461a3-1340-4304-a9c6-552714cfcafd None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:02.462031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f87461a3-1340-4304-a9c6-552714cfcafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:02.467059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59def13d-5379-4f69-9ac0-c2f69dc6e287 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:02.491080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c814e4-e5b2-4a24-8968-c608d6ef1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:02.491765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c814e4-e5b2-4a24-8968-c608d6ef1943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.492322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c814e4-e5b2-4a24-8968-c608d6ef1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.492493 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 721/1431] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:02.492580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c814e4-e5b2-4a24-8968-c608d6ef1943 admin admin] PATH_INFO: `/v3/projects/128d40c815fd4291a2e2ae416d4379ba/users/cc41b14913a44ea2ad8f616a20256a5b/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.494317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87461a3-1340-4304-a9c6-552714cfcafd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:02.496602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f87461a3-1340-4304-a9c6-552714cfcafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:02.522761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c814e4-e5b2-4a24-8968-c608d6ef1943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128d40c815fd4291a2e2ae416d4379ba, user_id=cc41b14913a44ea2ad8f616a20256a5b, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:02.525468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c814e4-e5b2-4a24-8968-c608d6ef1943 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:02.530652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87461a3-1340-4304-a9c6-552714cfcafd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:02.544692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:02.546418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.546659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.546919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] PATH_INFO: `/v3/projects/a3b683ba271545c1b105b6381f485351` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.554631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 711/1432] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:02 2022] PUT /identity/v3/projects/128d40c815fd4291a2e2ae416d4379ba/users/cc41b14913a44ea2ad8f616a20256a5b/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:02.556982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b683ba271545c1b105b6381f485351)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:02.560513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:02.571636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c814e4-e5b2-4a24-8968-c608d6ef1943 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:02.708228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b683ba271545c1b105b6381f485351', 'request_id': 'req-ee0639c0-3090-4457-9745-7254aad8ee00'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.724026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b683ba271545c1b105b6381f485351', 'request_id': 'req-ee0639c0-3090-4457-9745-7254aad8ee00'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.738387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b683ba271545c1b105b6381f485351', 'request_id': 'req-ee0639c0-3090-4457-9745-7254aad8ee00'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.753179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c814e4-e5b2-4a24-8968-c608d6ef1943 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:02.763813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] The token cache is being invalidate because project a3b683ba271545c1b105b6381f485351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:02.764170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.766991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ee0639c0-3090-4457-9745-7254aad8ee00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:02.772247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 722/1433] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:02 2022] DELETE /identity/v3/projects/a3b683ba271545c1b105b6381f485351 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:02.777526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25bf12-7619-4de2-ba0d-945be1580cbb None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.777858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25bf12-7619-4de2-ba0d-945be1580cbb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.778120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25bf12-7619-4de2-ba0d-945be1580cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.866228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fc25bf12-7619-4de2-ba0d-945be1580cbb None None] MFA Rules not processed for user `cc41b14913a44ea2ad8f616a20256a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:02.869575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fc25bf12-7619-4de2-ba0d-945be1580cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:02.902899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8f055-6c9e-45f4-a8ca-9333e233b2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:02.903537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8f055-6c9e-45f4-a8ca-9333e233b2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.903812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8f055-6c9e-45f4-a8ca-9333e233b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.904082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8f055-6c9e-45f4-a8ca-9333e233b2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:02.904753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8f055-6c9e-45f4-a8ca-9333e233b2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:02.905083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8f055-6c9e-45f4-a8ca-9333e233b2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:02.906772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8f055-6c9e-45f4-a8ca-9333e233b2f1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:02.946069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 712/1434] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:02.954468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70469-261d-423d-a78b-528f01485656 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:02.954766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70469-261d-423d-a78b-528f01485656 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:02.955034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a70469-261d-423d-a78b-528f01485656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.022107 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-09a70469-261d-423d-a78b-528f01485656 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:03.023729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-09a70469-261d-423d-a78b-528f01485656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:03.036326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 713/1435] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:03.037617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70469-261d-423d-a78b-528f01485656 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:03.046902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-09a70469-261d-423d-a78b-528f01485656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:03.053810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 723/1436] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:03.064857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a70469-261d-423d-a78b-528f01485656 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:03.065543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57775d2-d71b-425c-bed0-9fc77b17fbfd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.065849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57775d2-d71b-425c-bed0-9fc77b17fbfd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.066102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57775d2-d71b-425c-bed0-9fc77b17fbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.070815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343f14a-02df-412f-bc7c-51553b9848c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:03.071371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f14a-02df-412f-bc7c-51553b9848c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.071816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f14a-02df-412f-bc7c-51553b9848c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.072109 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343f14a-02df-412f-bc7c-51553b9848c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.072850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343f14a-02df-412f-bc7c-51553b9848c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:03.085261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343f14a-02df-412f-bc7c-51553b9848c7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:03.108873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b57775d2-d71b-425c-bed0-9fc77b17fbfd None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:03.110055 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b57775d2-d71b-425c-bed0-9fc77b17fbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:03.130406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:03.133995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 724/1437] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:03.134868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57775d2-d71b-425c-bed0-9fc77b17fbfd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:03.138591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b57775d2-d71b-425c-bed0-9fc77b17fbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:03.160871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 714/1438] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:03 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:03.162950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343f14a-02df-412f-bc7c-51553b9848c7 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:03.245597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:03.256686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57775d2-d71b-425c-bed0-9fc77b17fbfd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:03.358647 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343f14a-02df-412f-bc7c-51553b9848c7 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:03.374131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:03.374762 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.375229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.375356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.375939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:03.376240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:03.377964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:03.424261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 715/1439] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:03.424261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:03.428173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2ccb-96cc-4fd8-9618-e580dbfddc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:03.428861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2ccb-96cc-4fd8-9618-e580dbfddc8b service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.429785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2ccb-96cc-4fd8-9618-e580dbfddc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.430235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2ccb-96cc-4fd8-9618-e580dbfddc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.449961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01052f87-1dfd-40fb-a963-492a6bfd6efd admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:03.463267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9f0c7-7bcc-4c19-991a-6a21c93e4c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:03.465374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f0c7-7bcc-4c19-991a-6a21c93e4c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.477763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f0c7-7bcc-4c19-991a-6a21c93e4c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.478143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9f0c7-7bcc-4c19-991a-6a21c93e4c9f admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.482726 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9f0c7-7bcc-4c19-991a-6a21c93e4c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:03.490513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9f0c7-7bcc-4c19-991a-6a21c93e4c9f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:03.601715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2ccb-96cc-4fd8-9618-e580dbfddc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:03.602268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 716/1440] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:03 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:03.603658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2ccb-96cc-4fd8-9618-e580dbfddc8b service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:03.604077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f1817-3f13-48a2-b9f7-3dc23368618e None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.604495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f1817-3f13-48a2-b9f7-3dc23368618e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.604947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f1817-3f13-48a2-b9f7-3dc23368618e None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.619354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 717/1441] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 13:00:03 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:00:03.625976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f1817-3f13-48a2-b9f7-3dc23368618e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:03.626706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 725/1442] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:03.627875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2ccb-96cc-4fd8-9618-e580dbfddc8b service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:03.659343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2ccb-96cc-4fd8-9618-e580dbfddc8b service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:03.666216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f1817-3f13-48a2-b9f7-3dc23368618e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:03.673207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa298e0c-b652-4324-bc8d-40b4ab00b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:03.674433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298e0c-b652-4324-bc8d-40b4ab00b0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.675545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298e0c-b652-4324-bc8d-40b4ab00b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.675980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298e0c-b652-4324-bc8d-40b4ab00b0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.676611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298e0c-b652-4324-bc8d-40b4ab00b0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:03.678353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298e0c-b652-4324-bc8d-40b4ab00b0c2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:03.680588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:03.681549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.681913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.682264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.684073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:03.690008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:03.735104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 726/1443] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:03.736414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553860-bb0f-4fc4-a277-e7c81051f19f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:03.736707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553860-bb0f-4fc4-a277-e7c81051f19f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:03.736978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc553860-bb0f-4fc4-a277-e7c81051f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:03.788927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 718/1444] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:03 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:03.791321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:03.795450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cc553860-bb0f-4fc4-a277-e7c81051f19f None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:03.796741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:03.797805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cc553860-bb0f-4fc4-a277-e7c81051f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:03.987949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708715a-afbb-4c1c-b32c-fc77182ee269 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:03.994099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:03.999531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.000104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.000543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] PATH_INFO: `/v3/users/cc41b14913a44ea2ad8f616a20256a5b` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:04.002529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc41b14913a44ea2ad8f616a20256a5b)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:04.005547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:04.083944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 727/1445] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:04.084782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc553860-bb0f-4fc4-a277-e7c81051f19f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:04.108417 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc41b14913a44ea2ad8f616a20256a5b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:04.115726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc553860-bb0f-4fc4-a277-e7c81051f19f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:04.124342 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:04.126766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:04.127543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.127831 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.128107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:04.130094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:04.133699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:04.146834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc41b14913a44ea2ad8f616a20256a5b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:04.148561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc41b14913a44ea2ad8f616a20256a5b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:04.160070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 728/1446] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:04.161188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:04.166262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc41b14913a44ea2ad8f616a20256a5b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:04.168199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc41b14913a44ea2ad8f616a20256a5b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:04.169572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:04.194807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e6db-50b7-4b80-b53a-ef96f511cb30 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:04.211076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 719/1447] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:03 2022] DELETE /identity/v3/users/cc41b14913a44ea2ad8f616a20256a5b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:04.212325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:04.214752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8b5c4-f32a-49e8-9bce-4e2cae16db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:04.215627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b5c4-f32a-49e8-9bce-4e2cae16db54 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.216052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b5c4-f32a-49e8-9bce-4e2cae16db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.216474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b5c4-f32a-49e8-9bce-4e2cae16db54 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:04.217280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8b5c4-f32a-49e8-9bce-4e2cae16db54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:04.219025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:04.219918 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8b5c4-f32a-49e8-9bce-4e2cae16db54 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:04.275169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 729/1448] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:04 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:04.276820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96d299-4338-4b4f-a042-1c7d708261cd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.283772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96d299-4338-4b4f-a042-1c7d708261cd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.284266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96d299-4338-4b4f-a042-1c7d708261cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:04.329980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2e96d299-4338-4b4f-a042-1c7d708261cd None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:04.331306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2e96d299-4338-4b4f-a042-1c7d708261cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:04.351996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:04.461347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784998c-ae4c-4d40-8369-3833ec39d0f9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:04.472003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 730/1449] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:04.473048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96d299-4338-4b4f-a042-1c7d708261cd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:04.478257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2e96d299-4338-4b4f-a042-1c7d708261cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:04.488290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f35af-15f1-4a8e-9b40-cd6d80dc62da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:04.489298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f35af-15f1-4a8e-9b40-cd6d80dc62da admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.489754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f35af-15f1-4a8e-9b40-cd6d80dc62da admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.497668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f35af-15f1-4a8e-9b40-cd6d80dc62da admin admin] PATH_INFO: `/v3/projects/727dc293fe5748cda834b4bf68a18c1d/users/886edb72b3ee4d19a117590078a8a42e/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:04.547377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f35af-15f1-4a8e-9b40-cd6d80dc62da admin admin] RBAC: Authorizing `identity:create_grant(project_id=727dc293fe5748cda834b4bf68a18c1d, user_id=886edb72b3ee4d19a117590078a8a42e, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:04.551832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f35af-15f1-4a8e-9b40-cd6d80dc62da admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:04.584302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 720/1450] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:04 2022] PUT /identity/v3/projects/727dc293fe5748cda834b4bf68a18c1d/users/886edb72b3ee4d19a117590078a8a42e/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:04.585357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f35af-15f1-4a8e-9b40-cd6d80dc62da admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:04.664449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96d299-4338-4b4f-a042-1c7d708261cd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:04.770962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f35af-15f1-4a8e-9b40-cd6d80dc62da admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:04.776250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4b4a0-3f41-4836-9158-ee94f508587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:04.777003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4b4a0-3f41-4836-9158-ee94f508587d admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.777215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4b4a0-3f41-4836-9158-ee94f508587d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.777506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4b4a0-3f41-4836-9158-ee94f508587d admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:04.778677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4b4a0-3f41-4836-9158-ee94f508587d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:04.780589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4b4a0-3f41-4836-9158-ee94f508587d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:04.797728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 721/1451] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:04.800167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5591e-139a-4819-9598-ccc83978e851 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.800468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5591e-139a-4819-9598-ccc83978e851 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.800750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5591e-139a-4819-9598-ccc83978e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:04.822538 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-7cf5591e-139a-4819-9598-ccc83978e851 None None] MFA Rules not processed for user `0bcbf6513b6a4df3b044fadfb7888d54`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:04.823870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7cf5591e-139a-4819-9598-ccc83978e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:04.854290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:04.856110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.856537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.857175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:04.859752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:04.882636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:04.885306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:04.914532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:04.921913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 731/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:04.922910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:04.934322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:04.938859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 722/1453] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:04.942175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc015-1370-4c84-a800-f23ca48c153e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:04.942463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc015-1370-4c84-a800-f23ca48c153e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:04.942740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc015-1370-4c84-a800-f23ca48c153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:05.026887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:05.040165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2cccc015-1370-4c84-a800-f23ca48c153e None None] MFA Rules not processed for user `886edb72b3ee4d19a117590078a8a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:05.047219 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2cccc015-1370-4c84-a800-f23ca48c153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:05.079117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441eb9e-dc89-4fa7-930e-55dc3145e2bf service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:05.090226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02e61b-ced3-43c9-9ce6-be37b4400361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:05.090803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e61b-ced3-43c9-9ce6-be37b4400361 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:05.091077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e61b-ced3-43c9-9ce6-be37b4400361 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:05.104466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02e61b-ced3-43c9-9ce6-be37b4400361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:05.165384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02e61b-ced3-43c9-9ce6-be37b4400361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:05.166868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02e61b-ced3-43c9-9ce6-be37b4400361 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:05.208547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 732/1454] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:05.209973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02e61b-ced3-43c9-9ce6-be37b4400361 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:05.226345 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02e61b-ced3-43c9-9ce6-be37b4400361 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:05.252218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ea41f-d35e-4319-8983-3230a89128d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:05.252847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea41f-d35e-4319-8983-3230a89128d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:05.253124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea41f-d35e-4319-8983-3230a89128d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:05.253403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea41f-d35e-4319-8983-3230a89128d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:05.254181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ea41f-d35e-4319-8983-3230a89128d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:05.259239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ea41f-d35e-4319-8983-3230a89128d8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:05.311689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 723/1455] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:05.312685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc015-1370-4c84-a800-f23ca48c153e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:05.325561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 733/1456] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:05.331386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ea41f-d35e-4319-8983-3230a89128d8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:05.343897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc015-1370-4c84-a800-f23ca48c153e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:05.354195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867ba8-e658-4a4d-ac8c-d15d9b5cbc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:05.355043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867ba8-e658-4a4d-ac8c-d15d9b5cbc86 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:05.355323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867ba8-e658-4a4d-ac8c-d15d9b5cbc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:05.355595 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867ba8-e658-4a4d-ac8c-d15d9b5cbc86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:05.356248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84867ba8-e658-4a4d-ac8c-d15d9b5cbc86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:05.358216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84867ba8-e658-4a4d-ac8c-d15d9b5cbc86 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:05.366735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ea41f-d35e-4319-8983-3230a89128d8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:05.377318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba310c-ba86-4bd3-8e16-8cb62e9aade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:05.386236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba310c-ba86-4bd3-8e16-8cb62e9aade3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:05.386719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba310c-ba86-4bd3-8e16-8cb62e9aade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:05.387135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba310c-ba86-4bd3-8e16-8cb62e9aade3 admin admin] PATH_INFO: `/v3/projects/8142e41c98e144e5bb587fdbbc4efe97/users/d0235ae805c44df09211f35cf1cfc14a/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:05.448854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 724/1457] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:05 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:05.450901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba310c-ba86-4bd3-8e16-8cb62e9aade3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8142e41c98e144e5bb587fdbbc4efe97, user_id=d0235ae805c44df09211f35cf1cfc14a, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:05.454226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba310c-ba86-4bd3-8e16-8cb62e9aade3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:05.458095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867ba8-e658-4a4d-ac8c-d15d9b5cbc86 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:05.482364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 734/1458] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:05 2022] PUT /identity/v3/projects/8142e41c98e144e5bb587fdbbc4efe97/users/d0235ae805c44df09211f35cf1cfc14a/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:05.498115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd699b-1ba9-41cb-9e68-1bbc4e6d8f68 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:05.498418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd699b-1ba9-41cb-9e68-1bbc4e6d8f68 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:05.498880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd699b-1ba9-41cb-9e68-1bbc4e6d8f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:05.582584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-70fd699b-1ba9-41cb-9e68-1bbc4e6d8f68 None None] MFA Rules not processed for user `d0235ae805c44df09211f35cf1cfc14a`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:05.583962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-70fd699b-1ba9-41cb-9e68-1bbc4e6d8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:05.693093 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867ba8-e658-4a4d-ac8c-d15d9b5cbc86 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:05.834256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 735/1459] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:05.845683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd699b-1ba9-41cb-9e68-1bbc4e6d8f68 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:05.871394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a33e-c4ec-4be8-971d-8897b41dfcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:05.872478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a33e-c4ec-4be8-971d-8897b41dfcea admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:05.872802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a33e-c4ec-4be8-971d-8897b41dfcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:05.874200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a33e-c4ec-4be8-971d-8897b41dfcea admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:05.876551 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1a33e-c4ec-4be8-971d-8897b41dfcea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:05.883624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1a33e-c4ec-4be8-971d-8897b41dfcea admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:05.922345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:05.949730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 725/1460] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:05 2022] POST /identity/v3/users => generated 294 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:05.951449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a33e-c4ec-4be8-971d-8897b41dfcea admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:05.985049 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd699b-1ba9-41cb-9e68-1bbc4e6d8f68 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:05.991900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a33e-c4ec-4be8-971d-8897b41dfcea admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:05.999145 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeafda-30e5-41a2-9b03-4215969a46bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.000104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeafda-30e5-41a2-9b03-4215969a46bb admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.000595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeafda-30e5-41a2-9b03-4215969a46bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.001088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeafda-30e5-41a2-9b03-4215969a46bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.003195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeafda-30e5-41a2-9b03-4215969a46bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.004284 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aae4d-1a9b-4421-a222-64c29fde6284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.004932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aae4d-1a9b-4421-a222-64c29fde6284 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.005352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aae4d-1a9b-4421-a222-64c29fde6284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.005716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aae4d-1a9b-4421-a222-64c29fde6284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.010265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992aae4d-1a9b-4421-a222-64c29fde6284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.011211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeafda-30e5-41a2-9b03-4215969a46bb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.011968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992aae4d-1a9b-4421-a222-64c29fde6284 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.045044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 726/1461] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:06.046183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aae4d-1a9b-4421-a222-64c29fde6284 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:06.063316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aae4d-1a9b-4421-a222-64c29fde6284 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:06.083506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518199-2eed-41e6-941f-8ec3ef4ebeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.087991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518199-2eed-41e6-941f-8ec3ef4ebeaa admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.088443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518199-2eed-41e6-941f-8ec3ef4ebeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.088903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518199-2eed-41e6-941f-8ec3ef4ebeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.089761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518199-2eed-41e6-941f-8ec3ef4ebeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.091576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518199-2eed-41e6-941f-8ec3ef4ebeaa admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.103512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 736/1462] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:05 2022] POST /identity/v3/projects => generated 389 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:06.107990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeafda-30e5-41a2-9b03-4215969a46bb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:06.121713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 727/1463] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:06.124125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518199-2eed-41e6-941f-8ec3ef4ebeaa admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:06.148017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518199-2eed-41e6-941f-8ec3ef4ebeaa admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:06.172804 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:06.313132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00833839-e361-4b2b-b61b-2c0cd1653d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.313893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00833839-e361-4b2b-b61b-2c0cd1653d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.314123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeafda-30e5-41a2-9b03-4215969a46bb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:06.314223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00833839-e361-4b2b-b61b-2c0cd1653d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.314553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00833839-e361-4b2b-b61b-2c0cd1653d3a admin admin] PATH_INFO: `/v3/projects/b1e9d39cebba422eb23cc26a5e7d77d8/users/aaec62a0c3324b8abc749a291f42e49e/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.330011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801d56-0589-4fe6-9b95-58402b9201e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.330883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801d56-0589-4fe6-9b95-58402b9201e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.331237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801d56-0589-4fe6-9b95-58402b9201e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.331624 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801d56-0589-4fe6-9b95-58402b9201e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.333742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801d56-0589-4fe6-9b95-58402b9201e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.340676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801d56-0589-4fe6-9b95-58402b9201e9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.349933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00833839-e361-4b2b-b61b-2c0cd1653d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e9d39cebba422eb23cc26a5e7d77d8, user_id=aaec62a0c3324b8abc749a291f42e49e, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.352916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00833839-e361-4b2b-b61b-2c0cd1653d3a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.395315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 737/1464] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:06 2022] POST /identity/v3/users => generated 301 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:06.396248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801d56-0589-4fe6-9b95-58402b9201e9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:06.402115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 728/1465] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:06 2022] PUT /identity/v3/projects/b1e9d39cebba422eb23cc26a5e7d77d8/users/aaec62a0c3324b8abc749a291f42e49e/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:06.416225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f251be-7042-4116-b517-9edbb55ddc49 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.416692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f251be-7042-4116-b517-9edbb55ddc49 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.417038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f251be-7042-4116-b517-9edbb55ddc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.430064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801d56-0589-4fe6-9b95-58402b9201e9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:06.485933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-00f251be-7042-4116-b517-9edbb55ddc49 None None] MFA Rules not processed for user `aaec62a0c3324b8abc749a291f42e49e`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:06.487762 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-00f251be-7042-4116-b517-9edbb55ddc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:06.539087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a26d-478d-4325-9b93-894ef1d578cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.539982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a26d-478d-4325-9b93-894ef1d578cb admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.540438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a26d-478d-4325-9b93-894ef1d578cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.540897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277a26d-478d-4325-9b93-894ef1d578cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.542645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277a26d-478d-4325-9b93-894ef1d578cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.545993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277a26d-478d-4325-9b93-894ef1d578cb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.570528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 738/1466] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:06.572009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a26d-478d-4325-9b93-894ef1d578cb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:06.594602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277a26d-478d-4325-9b93-894ef1d578cb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:06.608618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da1ded-8995-49ac-a536-93d36fa3a3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.610080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da1ded-8995-49ac-a536-93d36fa3a3f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.610777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da1ded-8995-49ac-a536-93d36fa3a3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.611574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da1ded-8995-49ac-a536-93d36fa3a3f5 admin admin] PATH_INFO: `/v3/projects/25dfcb8f04ff4468977562aedac5f249/users/b4a4789ddcdd4d3d937683986e4c8ea0/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.650427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da1ded-8995-49ac-a536-93d36fa3a3f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25dfcb8f04ff4468977562aedac5f249, user_id=b4a4789ddcdd4d3d937683986e4c8ea0, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.655007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da1ded-8995-49ac-a536-93d36fa3a3f5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.716213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 729/1467] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:06.717174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 739/1468] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:06 2022] PUT /identity/v3/projects/25dfcb8f04ff4468977562aedac5f249/users/b4a4789ddcdd4d3d937683986e4c8ea0/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:06.723388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f251be-7042-4116-b517-9edbb55ddc49 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:06.724971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da1ded-8995-49ac-a536-93d36fa3a3f5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:06.757212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f251be-7042-4116-b517-9edbb55ddc49 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:06.885399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:06.919544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34caa1-b056-4338-b204-eab6a8b39161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.920974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34caa1-b056-4338-b204-eab6a8b39161 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.921258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34caa1-b056-4338-b204-eab6a8b39161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.921612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34caa1-b056-4338-b204-eab6a8b39161 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.921934 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da1ded-8995-49ac-a536-93d36fa3a3f5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:06.923139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34caa1-b056-4338-b204-eab6a8b39161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.929038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34caa1-b056-4338-b204-eab6a8b39161 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.932432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:06.935020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:06.935299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:06.935575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:06.937208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:06.942573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:06.992766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 740/1469] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:06.995996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:06.998153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:07.021069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 730/1470] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:06 2022] POST /identity/v3/projects => generated 387 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:07.023291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34caa1-b056-4338-b204-eab6a8b39161 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:07.037692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82ce3c-4c34-48cf-8dfd-c4c0b81c3191 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:07.060768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:07.188468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34caa1-b056-4338-b204-eab6a8b39161 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:07.200884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399661-d9b9-4926-a841-6d4fda151787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:07.207793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:07.212057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399661-d9b9-4926-a841-6d4fda151787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:07.212345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399661-d9b9-4926-a841-6d4fda151787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:07.212631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399661-d9b9-4926-a841-6d4fda151787 admin admin] PATH_INFO: `/v3/projects/25dfcb8f04ff4468977562aedac5f249/users/b4a4789ddcdd4d3d937683986e4c8ea0/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:07.213340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:07.214291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:07.214767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] PATH_INFO: `/v3/projects/e69202a735614390a60b78f3d9e6af06` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:07.220369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e399661-d9b9-4926-a841-6d4fda151787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25dfcb8f04ff4468977562aedac5f249, user_id=b4a4789ddcdd4d3d937683986e4c8ea0, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:07.221515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69202a735614390a60b78f3d9e6af06)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:07.223930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:07.226710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e399661-d9b9-4926-a841-6d4fda151787 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:07.259058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 731/1471] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:07 2022] PUT /identity/v3/projects/25dfcb8f04ff4468977562aedac5f249/users/b4a4789ddcdd4d3d937683986e4c8ea0/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:07.260499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399661-d9b9-4926-a841-6d4fda151787 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:07.331618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69202a735614390a60b78f3d9e6af06', 'request_id': 'req-eb547934-c88f-4335-9912-c5f96bd5a21c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.339966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69202a735614390a60b78f3d9e6af06', 'request_id': 'req-eb547934-c88f-4335-9912-c5f96bd5a21c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.352959 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399661-d9b9-4926-a841-6d4fda151787 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:07.360663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69202a735614390a60b78f3d9e6af06', 'request_id': 'req-eb547934-c88f-4335-9912-c5f96bd5a21c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.389892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] The token cache is being invalidate because project e69202a735614390a60b78f3d9e6af06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:07.392031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.394247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-eb547934-c88f-4335-9912-c5f96bd5a21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.397819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 741/1472] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:06 2022] DELETE /identity/v3/projects/e69202a735614390a60b78f3d9e6af06 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:07.403703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c1c70-826a-4ef8-953c-729c6faefed5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:07.404102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c1c70-826a-4ef8-953c-729c6faefed5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:07.404453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c1c70-826a-4ef8-953c-729c6faefed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:07.442729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d33c1c70-826a-4ef8-953c-729c6faefed5 None None] MFA Rules not processed for user `b4a4789ddcdd4d3d937683986e4c8ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:07.444035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d33c1c70-826a-4ef8-953c-729c6faefed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:07.517253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:07.518625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:07.518625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:07.518917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:07.519828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:07.521974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:07.565074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 732/1473] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:07 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:07.566257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:07.581336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:07.614932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:07.621523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 742/1474] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:07.622382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c1c70-826a-4ef8-953c-729c6faefed5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:07.632003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33768d-66aa-465e-a957-df12d8c5e778 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:07.633967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d33c1c70-826a-4ef8-953c-729c6faefed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:07.661304 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c1c70-826a-4ef8-953c-729c6faefed5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:07.661731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:07.663823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:07.664469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:07.665176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] PATH_INFO: `/v3/users/d28e279cf1de408c85d135b49a81128e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:07.671270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:07.672048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:07.672461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:07.672753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28e279cf1de408c85d135b49a81128e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:07.673203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] PATH_INFO: `/v3/projects/128d40c815fd4291a2e2ae416d4379ba` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:07.680128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:07.688625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=128d40c815fd4291a2e2ae416d4379ba)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:07.697324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:07.763535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:07.811537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28e279cf1de408c85d135b49a81128e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.818095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128d40c815fd4291a2e2ae416d4379ba', 'request_id': 'req-a9bf700c-803e-42f7-9d7c-56fd57f85366'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.830189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128d40c815fd4291a2e2ae416d4379ba', 'request_id': 'req-a9bf700c-803e-42f7-9d7c-56fd57f85366'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.839726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128d40c815fd4291a2e2ae416d4379ba', 'request_id': 'req-a9bf700c-803e-42f7-9d7c-56fd57f85366'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.865183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] The token cache is being invalidate because project 128d40c815fd4291a2e2ae416d4379ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:07.865405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.865990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.866582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28e279cf1de408c85d135b49a81128e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.869264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28e279cf1de408c85d135b49a81128e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.872759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 743/1475] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:07 2022] DELETE /identity/v3/projects/128d40c815fd4291a2e2ae416d4379ba => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:07.873703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:07.879041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:07.900521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28e279cf1de408c85d135b49a81128e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.901136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28e279cf1de408c85d135b49a81128e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:07.956863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 733/1476] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:07 2022] DELETE /identity/v3/users/d28e279cf1de408c85d135b49a81128e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:07.958014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:07.962924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:08.095180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf700c-803e-42f7-9d7c-56fd57f85366 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:08.095791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439bec-e250-481e-8fc2-979d1c461d70 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:08.113877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:08.115652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.116093 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.116512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.123972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:08.225298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ffd37-2eef-4470-a43e-a433417e2668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:08.226578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffd37-2eef-4470-a43e-a433417e2668 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.227092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffd37-2eef-4470-a43e-a433417e2668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.227590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffd37-2eef-4470-a43e-a433417e2668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.228694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ffd37-2eef-4470-a43e-a433417e2668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:08.231376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ffd37-2eef-4470-a43e-a433417e2668 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:08.247238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 744/1477] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:08.249654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866fe8-3332-4805-9c01-75c22d6de217 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.250237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866fe8-3332-4805-9c01-75c22d6de217 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.250652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866fe8-3332-4805-9c01-75c22d6de217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.269229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:08.270716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:08.290162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 734/1478] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:07 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:08.294573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-33866fe8-3332-4805-9c01-75c22d6de217 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:08.298614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-33866fe8-3332-4805-9c01-75c22d6de217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:08.305398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:08.316634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:08.324861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 745/1479] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:08.344269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a2e4-0bcb-4e5e-b81c-5b6e9762fce7 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.344987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a2e4-0bcb-4e5e-b81c-5b6e9762fce7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.345444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a2e4-0bcb-4e5e-b81c-5b6e9762fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.368801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630ce2-2d3f-4c0c-9d3e-4b11a831b294 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:08.385003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29b5f-c039-45f8-85ba-18aede693102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:08.385929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29b5f-c039-45f8-85ba-18aede693102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.386204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29b5f-c039-45f8-85ba-18aede693102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.386476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29b5f-c039-45f8-85ba-18aede693102 admin admin] PATH_INFO: `/v3/projects/3731365e0025431aa2d9d5ede76e893d/users/f6bc9f6ce2a343ed99eba54af33234ec/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.421584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29b5f-c039-45f8-85ba-18aede693102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3731365e0025431aa2d9d5ede76e893d, user_id=f6bc9f6ce2a343ed99eba54af33234ec, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:08.426692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29b5f-c039-45f8-85ba-18aede693102 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:08.431311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-59d7a2e4-0bcb-4e5e-b81c-5b6e9762fce7 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:08.437761 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-59d7a2e4-0bcb-4e5e-b81c-5b6e9762fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:08.474865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 735/1480] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:08 2022] PUT /identity/v3/projects/3731365e0025431aa2d9d5ede76e893d/users/f6bc9f6ce2a343ed99eba54af33234ec/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:08.481676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20156e5e-bef9-4bd3-8f35-cb3bf2ed66e8 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.482793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20156e5e-bef9-4bd3-8f35-cb3bf2ed66e8 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.483258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20156e5e-bef9-4bd3-8f35-cb3bf2ed66e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.503096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:08.536861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-20156e5e-bef9-4bd3-8f35-cb3bf2ed66e8 None None] MFA Rules not processed for user `9394667740f44bcab24ee484b195fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:08.539331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-20156e5e-bef9-4bd3-8f35-cb3bf2ed66e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:08.575360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:08.617026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 746/1481] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:08.618056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7a2e4-0bcb-4e5e-b81c-5b6e9762fce7 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:08.639432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7a2e4-0bcb-4e5e-b81c-5b6e9762fce7 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:08.650469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:08.651151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.651959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.652278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.653020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:08.654776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:08.687435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 747/1482] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:08.687435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:08.691084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:08.715016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 736/1483] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:08.715992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20156e5e-bef9-4bd3-8f35-cb3bf2ed66e8 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:08.727273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc8245-c248-46c4-a160-1daa4c74dff0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:08.738307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:08.739011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.739331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.739446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20156e5e-bef9-4bd3-8f35-cb3bf2ed66e8 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:08.739608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] PATH_INFO: `/v3/users/d0235ae805c44df09211f35cf1cfc14a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.742659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0235ae805c44df09211f35cf1cfc14a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:08.748323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:08.752206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:08.757919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.758423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.760330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.761249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:08.762077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:08.766685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:08.797474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 737/1484] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:08.800481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:08.823152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71626ce2-7479-46bd-ab6a-44b09da8e898 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:08.840338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d99f60-ea44-4ed8-b29f-fa061a5b4ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:08.841876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d99f60-ea44-4ed8-b29f-fa061a5b4ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.842425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d99f60-ea44-4ed8-b29f-fa061a5b4ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.842972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d99f60-ea44-4ed8-b29f-fa061a5b4ae1 admin admin] PATH_INFO: `/v3/projects/3731365e0025431aa2d9d5ede76e893d/users/f6bc9f6ce2a343ed99eba54af33234ec/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:08.846074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d99f60-ea44-4ed8-b29f-fa061a5b4ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3731365e0025431aa2d9d5ede76e893d, user_id=f6bc9f6ce2a343ed99eba54af33234ec, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:08.852306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d99f60-ea44-4ed8-b29f-fa061a5b4ae1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:08.855412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0235ae805c44df09211f35cf1cfc14a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:08.877693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 738/1485] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:08 2022] PUT /identity/v3/projects/3731365e0025431aa2d9d5ede76e893d/users/f6bc9f6ce2a343ed99eba54af33234ec/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:08.879004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d99f60-ea44-4ed8-b29f-fa061a5b4ae1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:08.886829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0235ae805c44df09211f35cf1cfc14a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:08.887577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0235ae805c44df09211f35cf1cfc14a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:08.909854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0235ae805c44df09211f35cf1cfc14a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:08.910584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-af876cb6-6105-4b33-a9ba-4e2feacace74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0235ae805c44df09211f35cf1cfc14a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:08.944046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 748/1486] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:08 2022] DELETE /identity/v3/users/d0235ae805c44df09211f35cf1cfc14a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:08.954660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4b06-a30b-4855-a911-be351a5ea750 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:08.955189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4b06-a30b-4855-a911-be351a5ea750 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:08.955374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4b06-a30b-4855-a911-be351a5ea750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.026254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-346b4b06-a30b-4855-a911-be351a5ea750 None None] MFA Rules not processed for user `f6bc9f6ce2a343ed99eba54af33234ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:09.027931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-346b4b06-a30b-4855-a911-be351a5ea750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:09.032075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d99f60-ea44-4ed8-b29f-fa061a5b4ae1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:09.174438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 749/1487] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:09.180497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c21830-bd90-47de-a7c8-69e277aeca7d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.181124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c21830-bd90-47de-a7c8-69e277aeca7d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.181872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c21830-bd90-47de-a7c8-69e277aeca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.216237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-90c21830-bd90-47de-a7c8-69e277aeca7d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:09.217436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:09.218382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-90c21830-bd90-47de-a7c8-69e277aeca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:09.219441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.220146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.220990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.222906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:09.227050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:09.232764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 750/1488] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:09.233926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c21830-bd90-47de-a7c8-69e277aeca7d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:09.236128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-90c21830-bd90-47de-a7c8-69e277aeca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:09.278291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:09.302018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 739/1489] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:08 2022] POST /identity/v3/projects => generated 385 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:09.304131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:09.311431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:09.322147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c21830-bd90-47de-a7c8-69e277aeca7d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:09.345535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:09.427384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:09.427983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.428268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.428538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.446811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b100ee-6fe2-49f1-aa40-0de879eb0c6f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:09.463114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05e8d6-1d0d-4dd1-865c-22da505dbbc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:09.464339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05e8d6-1d0d-4dd1-865c-22da505dbbc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.465003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05e8d6-1d0d-4dd1-865c-22da505dbbc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.465512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05e8d6-1d0d-4dd1-865c-22da505dbbc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.619328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:09.623471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:09.627851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05e8d6-1d0d-4dd1-865c-22da505dbbc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:09.633614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05e8d6-1d0d-4dd1-865c-22da505dbbc7 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:09.651953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 751/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:09.654779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:09.658177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:09.661682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 740/1491] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:09.698348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b90e5-566a-4edc-9ef6-44ddb6554506 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:09.705189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdadeb-337f-4be6-88c9-b73eb8121a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:09.706157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdadeb-337f-4be6-88c9-b73eb8121a2f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.706511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdadeb-337f-4be6-88c9-b73eb8121a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.706967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdadeb-337f-4be6-88c9-b73eb8121a2f admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.707679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdadeb-337f-4be6-88c9-b73eb8121a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:09.709981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdadeb-337f-4be6-88c9-b73eb8121a2f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:09.751360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 752/1492] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:09 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:09.753515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05e8d6-1d0d-4dd1-865c-22da505dbbc7 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:09.768095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05e8d6-1d0d-4dd1-865c-22da505dbbc7 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:09.786759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576615e6-09c5-49e3-bb95-640468665d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:09.788777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576615e6-09c5-49e3-bb95-640468665d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.790077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576615e6-09c5-49e3-bb95-640468665d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.792356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576615e6-09c5-49e3-bb95-640468665d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.795112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576615e6-09c5-49e3-bb95-640468665d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:09.798583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576615e6-09c5-49e3-bb95-640468665d4c admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:09.813578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 741/1493] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:09.818385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdadeb-337f-4be6-88c9-b73eb8121a2f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:09.836991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdadeb-337f-4be6-88c9-b73eb8121a2f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:09.848350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fda3f-38e7-48fb-8144-b4352286d7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:09.848975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fda3f-38e7-48fb-8144-b4352286d7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.849263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fda3f-38e7-48fb-8144-b4352286d7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.849543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fda3f-38e7-48fb-8144-b4352286d7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.850196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fda3f-38e7-48fb-8144-b4352286d7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:09.851995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fda3f-38e7-48fb-8144-b4352286d7d8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:09.875163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576615e6-09c5-49e3-bb95-640468665d4c admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:09.887787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576615e6-09c5-49e3-bb95-640468665d4c admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:09.888539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 753/1494] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:09.898378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:09.899050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.899325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.899593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] PATH_INFO: `/v3/projects/d07f640fe9f64a2abe4e9106318cb4c3/users/1a1ab89ae7ec4a17b0989a202820cfc0/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:09.933502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07f640fe9f64a2abe4e9106318cb4c3, user_id=1a1ab89ae7ec4a17b0989a202820cfc0, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:09.940930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:09.973171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 742/1495] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:09 2022] PUT /identity/v3/projects/d07f640fe9f64a2abe4e9106318cb4c3/users/1a1ab89ae7ec4a17b0989a202820cfc0/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:09.987565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb1bb2-eb0d-4658-a8cf-5958a0defd19 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:09.987851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb1bb2-eb0d-4658-a8cf-5958a0defd19 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:09.988123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb1bb2-eb0d-4658-a8cf-5958a0defd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.053877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6aeb1bb2-eb0d-4658-a8cf-5958a0defd19 None None] MFA Rules not processed for user `1a1ab89ae7ec4a17b0989a202820cfc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:10.059285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6aeb1bb2-eb0d-4658-a8cf-5958a0defd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:10.065993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:10.068823 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:10.284380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:10.293024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa093d-613b-44ad-933e-48df406d52c1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:10.307744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 754/1496] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:10.308663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb1bb2-eb0d-4658-a8cf-5958a0defd19 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:10.312963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:10.313464 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.314846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.315138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] PATH_INFO: `/v3/projects/f7f1c0f057d747aab372762552f4cdad` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.319054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f1c0f057d747aab372762552f4cdad)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:10.321066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:10.339457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb1bb2-eb0d-4658-a8cf-5958a0defd19 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:10.374147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c92fb3-d826-4283-afa1-a5c77ec9d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:10.375950 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92fb3-d826-4283-afa1-a5c77ec9d50b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.386099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92fb3-d826-4283-afa1-a5c77ec9d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.386724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c92fb3-d826-4283-afa1-a5c77ec9d50b admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.394990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c92fb3-d826-4283-afa1-a5c77ec9d50b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:10.399443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c92fb3-d826-4283-afa1-a5c77ec9d50b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:10.444210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:10.480503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 755/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:10.482927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c92fb3-d826-4283-afa1-a5c77ec9d50b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:10.487082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f1c0f057d747aab372762552f4cdad', 'request_id': 'req-aad8197a-b08e-454d-aee0-7ea634c5d974'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:10.537218 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f1c0f057d747aab372762552f4cdad', 'request_id': 'req-aad8197a-b08e-454d-aee0-7ea634c5d974'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:10.558604 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f1c0f057d747aab372762552f4cdad', 'request_id': 'req-aad8197a-b08e-454d-aee0-7ea634c5d974'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:10.588467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] The token cache is being invalidate because project f7f1c0f057d747aab372762552f4cdad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:10.589825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:10.591996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aad8197a-b08e-454d-aee0-7ea634c5d974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:10.597533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 743/1498] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:10 2022] DELETE /identity/v3/projects/f7f1c0f057d747aab372762552f4cdad => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:10.606240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c65c5-300e-4842-865f-5513dc819a03 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.608310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c65c5-300e-4842-865f-5513dc819a03 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.609431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c65c5-300e-4842-865f-5513dc819a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.623530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c92fb3-d826-4283-afa1-a5c77ec9d50b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:10.641413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:10.642408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.643597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.644854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.646498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:10.654200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:10.655500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-409c65c5-300e-4842-865f-5513dc819a03 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:10.658536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-409c65c5-300e-4842-865f-5513dc819a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:10.687662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 744/1499] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:10.700086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf271e-e4a9-4540-a439-95d07deaa926 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.700519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf271e-e4a9-4540-a439-95d07deaa926 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.700624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf271e-e4a9-4540-a439-95d07deaa926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.716677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 756/1500] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:10 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:10.726556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:10.730499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:10.755374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1940-7d96-4422-8654-c1dad39f4e7a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:10.760328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-21cf271e-e4a9-4540-a439-95d07deaa926 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:10.770296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f24fb-25a1-4fdc-91da-469ed1e9e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:10.770702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f24fb-25a1-4fdc-91da-469ed1e9e875 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.770967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f24fb-25a1-4fdc-91da-469ed1e9e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.771238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f24fb-25a1-4fdc-91da-469ed1e9e875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.771889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f24fb-25a1-4fdc-91da-469ed1e9e875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:10.773578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f24fb-25a1-4fdc-91da-469ed1e9e875 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:10.777031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-21cf271e-e4a9-4540-a439-95d07deaa926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:10.818752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 757/1501] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:10.819600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 745/1502] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:10.819687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f24fb-25a1-4fdc-91da-469ed1e9e875 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:10.820998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf271e-e4a9-4540-a439-95d07deaa926 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:10.843302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf271e-e4a9-4540-a439-95d07deaa926 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:10.850739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f24fb-25a1-4fdc-91da-469ed1e9e875 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:10.857226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f38eac-0f91-49d9-89ca-8810d2793cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:10.858338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f38eac-0f91-49d9-89ca-8810d2793cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.858447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f38eac-0f91-49d9-89ca-8810d2793cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.859401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f38eac-0f91-49d9-89ca-8810d2793cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.864274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f38eac-0f91-49d9-89ca-8810d2793cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:10.864395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:10.864979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.865256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.865547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.866203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:10.866508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:10.868126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:10.868957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f38eac-0f91-49d9-89ca-8810d2793cf9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:10.893074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 758/1503] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:10.895979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:10.901094 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 746/1504] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:10.901799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:10.901907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f38eac-0f91-49d9-89ca-8810d2793cf9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:10.921759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f38eac-0f91-49d9-89ca-8810d2793cf9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:10.930145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5ae7-2e2e-46a5-936b-6be283bcbca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:10.931023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5ae7-2e2e-46a5-936b-6be283bcbca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:10.931374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5ae7-2e2e-46a5-936b-6be283bcbca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:10.932558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5ae7-2e2e-46a5-936b-6be283bcbca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:10.933740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a5ae7-2e2e-46a5-936b-6be283bcbca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:10.937526 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a5ae7-2e2e-46a5-936b-6be283bcbca4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:10.996472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 747/1505] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:10 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:10.997413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5ae7-2e2e-46a5-936b-6be283bcbca4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:11.003247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038acfb4-9505-46c2-8e9a-4a19fa73dddd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:11.083296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:11.084083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.084480 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.084838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.087713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:11.120441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:11.152681 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5ae7-2e2e-46a5-936b-6be283bcbca4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:11.172836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b86d1-728a-4052-8c9d-17e582c99169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:11.173749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b86d1-728a-4052-8c9d-17e582c99169 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.174133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b86d1-728a-4052-8c9d-17e582c99169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.174467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b86d1-728a-4052-8c9d-17e582c99169 admin admin] PATH_INFO: `/v3/projects/94b9f014c6404bb4ba13cc196e0c1fde/users/4e0149e5886a42ffbefd2dc7bf4ed21b/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.201193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b86d1-728a-4052-8c9d-17e582c99169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b9f014c6404bb4ba13cc196e0c1fde, user_id=4e0149e5886a42ffbefd2dc7bf4ed21b, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:11.207829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b86d1-728a-4052-8c9d-17e582c99169 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:11.233282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 748/1506] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:10 2022] PUT /identity/v3/projects/94b9f014c6404bb4ba13cc196e0c1fde/users/4e0149e5886a42ffbefd2dc7bf4ed21b/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:11.234686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b86d1-728a-4052-8c9d-17e582c99169 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:11.256428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:11.258517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:11.270597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 759/1507] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:11.285235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:11.291168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:11.312407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:11.319878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b86d1-728a-4052-8c9d-17e582c99169 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:11.327137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfb634-0e69-417a-a835-3e6194a29cc0 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:11.328703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1469c-0d2e-4c5c-8648-9b7337a69444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:11.330534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1469c-0d2e-4c5c-8648-9b7337a69444 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.331248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1469c-0d2e-4c5c-8648-9b7337a69444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.331995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1469c-0d2e-4c5c-8648-9b7337a69444 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.333232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1469c-0d2e-4c5c-8648-9b7337a69444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:11.333577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:11.334685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.334968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.335242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] PATH_INFO: `/v3/projects/8142e41c98e144e5bb587fdbbc4efe97` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.336413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1469c-0d2e-4c5c-8648-9b7337a69444 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:11.336530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8142e41c98e144e5bb587fdbbc4efe97)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:11.338505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:11.368445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 749/1508] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:11 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:11.370545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085c24-227d-4b22-b00c-6de8cc3f63e2 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.371281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085c24-227d-4b22-b00c-6de8cc3f63e2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.371461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085c24-227d-4b22-b00c-6de8cc3f63e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.424150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-26085c24-227d-4b22-b00c-6de8cc3f63e2 None None] MFA Rules not processed for user `4e0149e5886a42ffbefd2dc7bf4ed21b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:11.426574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-26085c24-227d-4b22-b00c-6de8cc3f63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:11.433721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8142e41c98e144e5bb587fdbbc4efe97', 'request_id': 'req-1c39d030-4c99-44ec-b740-e51a009a1c13'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.441847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8142e41c98e144e5bb587fdbbc4efe97', 'request_id': 'req-1c39d030-4c99-44ec-b740-e51a009a1c13'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.456886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8142e41c98e144e5bb587fdbbc4efe97', 'request_id': 'req-1c39d030-4c99-44ec-b740-e51a009a1c13'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.484486 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] The token cache is being invalidate because project 8142e41c98e144e5bb587fdbbc4efe97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:11.485341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.487366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.489900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 760/1509] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:11 2022] DELETE /identity/v3/projects/8142e41c98e144e5bb587fdbbc4efe97 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:11.491581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:11.493547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:11.542847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 750/1510] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:11.544406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26085c24-227d-4b22-b00c-6de8cc3f63e2 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:11.546614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-26085c24-227d-4b22-b00c-6de8cc3f63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:11.588712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39d030-4c99-44ec-b740-e51a009a1c13 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:11.596193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:11.598302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.598302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.598302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.598611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:11.600923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:11.615001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 761/1511] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:11.616025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:11.617909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:11.632870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26085c24-227d-4b22-b00c-6de8cc3f63e2 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:11.634699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d2fb8-48d5-4d6a-b17e-fa7d69718ff0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:11.638478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:11.639332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.639617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.639892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] PATH_INFO: `/v3/users/b4a4789ddcdd4d3d937683986e4c8ea0` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.641043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a4789ddcdd4d3d937683986e4c8ea0)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:11.641180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145b20-c5a6-4d6d-a3fc-f3e7ac98445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:11.642111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145b20-c5a6-4d6d-a3fc-f3e7ac98445d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.642466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145b20-c5a6-4d6d-a3fc-f3e7ac98445d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.642903 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35145b20-c5a6-4d6d-a3fc-f3e7ac98445d admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.643075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:11.643862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145b20-c5a6-4d6d-a3fc-f3e7ac98445d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:11.646358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35145b20-c5a6-4d6d-a3fc-f3e7ac98445d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:11.690523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 762/1512] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:11 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:11.690523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145b20-c5a6-4d6d-a3fc-f3e7ac98445d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:11.706511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a4789ddcdd4d3d937683986e4c8ea0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.721887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a4789ddcdd4d3d937683986e4c8ea0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.722677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a4789ddcdd4d3d937683986e4c8ea0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.727682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:11.737848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a4789ddcdd4d3d937683986e4c8ea0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.738659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-575b740b-aeca-4100-a5f4-66d6944de2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a4789ddcdd4d3d937683986e4c8ea0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:11.751343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:11.798033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 751/1513] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:11 2022] DELETE /identity/v3/users/b4a4789ddcdd4d3d937683986e4c8ea0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:11.799504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2852b-4870-407d-86cd-3b15f569bb82 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:11.811114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2852b-4870-407d-86cd-3b15f569bb82 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:11.812571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2852b-4870-407d-86cd-3b15f569bb82 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:11.816584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 752/1514] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 13:00:11 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:00:11.817529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2852b-4870-407d-86cd-3b15f569bb82 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:11.822141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bcf2852b-4870-407d-86cd-3b15f569bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:11.895615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35145b20-c5a6-4d6d-a3fc-f3e7ac98445d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.000458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2852b-4870-407d-86cd-3b15f569bb82 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.006291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cd04a-918a-48bd-aaae-9c47b586414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.007005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd04a-918a-48bd-aaae-9c47b586414b admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.007291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd04a-918a-48bd-aaae-9c47b586414b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.007564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd04a-918a-48bd-aaae-9c47b586414b admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.008215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cd04a-918a-48bd-aaae-9c47b586414b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.010222 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cd04a-918a-48bd-aaae-9c47b586414b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.027020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ad77-e190-4c26-9124-fd1fb93700bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.027679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ad77-e190-4c26-9124-fd1fb93700bb admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.027957 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ad77-e190-4c26-9124-fd1fb93700bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.028310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ad77-e190-4c26-9124-fd1fb93700bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.029560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5ad77-e190-4c26-9124-fd1fb93700bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.031619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5ad77-e190-4c26-9124-fd1fb93700bb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.048268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 753/1515] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:11 2022] POST /identity/v3/users => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:12.051985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcffe1-b199-41e6-88ba-8ec5f80dd892 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.052274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcffe1-b199-41e6-88ba-8ec5f80dd892 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.052588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcffe1-b199-41e6-88ba-8ec5f80dd892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.060104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 763/1516] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:12.060440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ad77-e190-4c26-9124-fd1fb93700bb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:12.082835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ad77-e190-4c26-9124-fd1fb93700bb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.091278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.092645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-28bcffe1-b199-41e6-88ba-8ec5f80dd892 None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:12.093204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.093758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.094201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-28bcffe1-b199-41e6-88ba-8ec5f80dd892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:12.094305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.095389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.097457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.131215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 764/1517] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:12.132274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:12.149101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:12.181412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3cd68-bce1-49be-bf62-b6c0e1f967fe admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.203499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688beb7-a619-4574-9dea-3cb49015edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.204184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688beb7-a619-4574-9dea-3cb49015edfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.204459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688beb7-a619-4574-9dea-3cb49015edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.204730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688beb7-a619-4574-9dea-3cb49015edfe admin admin] PATH_INFO: `/v3/projects/0cf6402a0dcf4cd9b79d2f2fb4769f08/users/bf7479d80273467ea50bdd9a8b26f4dc/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.257576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 754/1518] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:12.257715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688beb7-a619-4574-9dea-3cb49015edfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf6402a0dcf4cd9b79d2f2fb4769f08, user_id=bf7479d80273467ea50bdd9a8b26f4dc, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.269143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688beb7-a619-4574-9dea-3cb49015edfe admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.269235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcffe1-b199-41e6-88ba-8ec5f80dd892 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:12.288270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 765/1519] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:12 2022] PUT /identity/v3/projects/0cf6402a0dcf4cd9b79d2f2fb4769f08/users/bf7479d80273467ea50bdd9a8b26f4dc/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:12.298446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f8f80-04b9-4d33-979b-f89c83802eb4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.299249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f8f80-04b9-4d33-979b-f89c83802eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.299249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f8f80-04b9-4d33-979b-f89c83802eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.299427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcffe1-b199-41e6-88ba-8ec5f80dd892 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.351766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-528f8f80-04b9-4d33-979b-f89c83802eb4 None None] MFA Rules not processed for user `bf7479d80273467ea50bdd9a8b26f4dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:12.353730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-528f8f80-04b9-4d33-979b-f89c83802eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:12.404789 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.405491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.405778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.406044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] PATH_INFO: `/v3/projects/bd8f48e13a6b4ac086efb67182524d9c/users/f2d04955c6db423aae40b3406d2007c5/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.445340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8f48e13a6b4ac086efb67182524d9c, user_id=f2d04955c6db423aae40b3406d2007c5, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.451738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.463322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:12.474848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 755/1520] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:12 2022] PUT /identity/v3/projects/bd8f48e13a6b4ac086efb67182524d9c/users/f2d04955c6db423aae40b3406d2007c5/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:12.475715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:12.479258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:12.480444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 766/1521] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:12.481874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f8f80-04b9-4d33-979b-f89c83802eb4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:12.497603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:12.501260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f8f80-04b9-4d33-979b-f89c83802eb4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.582087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c1b59-5585-4cb8-81f0-fa906742c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.586144 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c1b59-5585-4cb8-81f0-fa906742c005 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.586423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c1b59-5585-4cb8-81f0-fa906742c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.586694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c1b59-5585-4cb8-81f0-fa906742c005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.587597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c1b59-5585-4cb8-81f0-fa906742c005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.589790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c1b59-5585-4cb8-81f0-fa906742c005 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.605136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 767/1522] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:12.610066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c1b59-5585-4cb8-81f0-fa906742c005 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:12.625813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c1b59-5585-4cb8-81f0-fa906742c005 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.632994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970b232-9aae-4c15-a650-a3e330c6a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.633196 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1fec-b431-4244-8e50-45581138fd56 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.633680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970b232-9aae-4c15-a650-a3e330c6a0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.636229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970b232-9aae-4c15-a650-a3e330c6a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.636536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970b232-9aae-4c15-a650-a3e330c6a0c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.637297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970b232-9aae-4c15-a650-a3e330c6a0c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.645531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970b232-9aae-4c15-a650-a3e330c6a0c3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.647391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.648040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.648272 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.648542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.666965 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.668460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.699390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 756/1523] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:12.701565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:12.703275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:12.726502 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 768/1524] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:12 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:12.727767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970b232-9aae-4c15-a650-a3e330c6a0c3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:12.751023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694b7a-4eb2-47bf-a540-28bf4020f0ce service nova] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.846118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.847256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.847542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.847864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] PATH_INFO: `/v3/projects/25dfcb8f04ff4468977562aedac5f249` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.849111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25dfcb8f04ff4468977562aedac5f249)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.851369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.932284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970b232-9aae-4c15-a650-a3e330c6a0c3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:12.954115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2df9-d15b-4972-a46f-c5d45b6b8f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:12.954115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2df9-d15b-4972-a46f-c5d45b6b8f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:12.954115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2df9-d15b-4972-a46f-c5d45b6b8f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:12.954115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf2df9-d15b-4972-a46f-c5d45b6b8f70 admin admin] PATH_INFO: `/v3/projects/bd8f48e13a6b4ac086efb67182524d9c/users/f2d04955c6db423aae40b3406d2007c5/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:12.958510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf2df9-d15b-4972-a46f-c5d45b6b8f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8f48e13a6b4ac086efb67182524d9c, user_id=f2d04955c6db423aae40b3406d2007c5, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:12.963134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf2df9-d15b-4972-a46f-c5d45b6b8f70 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:12.990241 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 769/1525] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:12 2022] PUT /identity/v3/projects/bd8f48e13a6b4ac086efb67182524d9c/users/f2d04955c6db423aae40b3406d2007c5/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:12.992767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2df9-d15b-4972-a46f-c5d45b6b8f70 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.033540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25dfcb8f04ff4468977562aedac5f249', 'request_id': 'req-012bdc28-8a74-4628-91b2-1ee6e498520a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:13.040479 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25dfcb8f04ff4468977562aedac5f249', 'request_id': 'req-012bdc28-8a74-4628-91b2-1ee6e498520a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:13.048597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25dfcb8f04ff4468977562aedac5f249', 'request_id': 'req-012bdc28-8a74-4628-91b2-1ee6e498520a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:13.070491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] The token cache is being invalidate because project 25dfcb8f04ff4468977562aedac5f249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:13.070790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:13.072894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-012bdc28-8a74-4628-91b2-1ee6e498520a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:13.078405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 757/1526] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:12 2022] DELETE /identity/v3/projects/25dfcb8f04ff4468977562aedac5f249 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:13.078405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073985-4d89-48af-842d-2144af2a0801 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.078405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073985-4d89-48af-842d-2144af2a0801 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.078824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073985-4d89-48af-842d-2144af2a0801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.134215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:13.138966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-dc073985-4d89-48af-842d-2144af2a0801 None None] MFA Rules not processed for user `f2d04955c6db423aae40b3406d2007c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:13.139551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf2df9-d15b-4972-a46f-c5d45b6b8f70 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.141103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-dc073985-4d89-48af-842d-2144af2a0801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:13.200922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:13.292338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 758/1527] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:13.293711 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685ba3-496b-491e-bfa5-f614fa28f1ad None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.293997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685ba3-496b-491e-bfa5-f614fa28f1ad None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.294486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1685ba3-496b-491e-bfa5-f614fa28f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.315461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06409f2-a960-464e-b05a-7c75f1a406f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.316208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06409f2-a960-464e-b05a-7c75f1a406f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.316617 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06409f2-a960-464e-b05a-7c75f1a406f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.317008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06409f2-a960-464e-b05a-7c75f1a406f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.317860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06409f2-a960-464e-b05a-7c75f1a406f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.320057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06409f2-a960-464e-b05a-7c75f1a406f7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.324667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d1685ba3-496b-491e-bfa5-f614fa28f1ad None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:13.325882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d1685ba3-496b-491e-bfa5-f614fa28f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:13.341954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 759/1528] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:13.343841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1685ba3-496b-491e-bfa5-f614fa28f1ad None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.345387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d1685ba3-496b-491e-bfa5-f614fa28f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:13.355207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 770/1529] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:12 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:13.364551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce822f8-8699-4c32-9a46-f3033dcbbbd3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.364851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce822f8-8699-4c32-9a46-f3033dcbbbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.365129 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce822f8-8699-4c32-9a46-f3033dcbbbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.426312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5ce822f8-8699-4c32-9a46-f3033dcbbbd3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:13.427169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1685ba3-496b-491e-bfa5-f614fa28f1ad None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.427788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5ce822f8-8699-4c32-9a46-f3033dcbbbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:13.433686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.434546 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.434968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.435477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.437747 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:13.449197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 771/1530] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:13.449197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce822f8-8699-4c32-9a46-f3033dcbbbd3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.449197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5ce822f8-8699-4c32-9a46-f3033dcbbbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:13.463189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce822f8-8699-4c32-9a46-f3033dcbbbd3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.471064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71b9cf-a2a8-403c-ab26-d2c155bed311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.471735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71b9cf-a2a8-403c-ab26-d2c155bed311 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.472019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71b9cf-a2a8-403c-ab26-d2c155bed311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.472292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71b9cf-a2a8-403c-ab26-d2c155bed311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.472951 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71b9cf-a2a8-403c-ab26-d2c155bed311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.474695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71b9cf-a2a8-403c-ab26-d2c155bed311 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.501913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 772/1531] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:13.502914 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71b9cf-a2a8-403c-ab26-d2c155bed311 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.517298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71b9cf-a2a8-403c-ab26-d2c155bed311 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.533794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.534405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.534685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.534951 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.535635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:13.535924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.537555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.549777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.551211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 773/1532] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:13.552018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.553618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.565070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 760/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:13.577735 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.592404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a48cc-c414-4ee9-9228-ae1d238257b2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.599583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d06e27-8e0e-4aa5-acf5-52df7c001ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.600551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06e27-8e0e-4aa5-acf5-52df7c001ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.601024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06e27-8e0e-4aa5-acf5-52df7c001ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.601543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d06e27-8e0e-4aa5-acf5-52df7c001ca0 admin admin] PATH_INFO: `/v3/projects/c92c518ee9dd4bc69381323ea696c3ad/users/73a60ee6396d4177a323b597444aec94/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.614330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bdb64-83cc-4d11-b3a9-7364c1d830d0 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.618906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d06e27-8e0e-4aa5-acf5-52df7c001ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92c518ee9dd4bc69381323ea696c3ad, user_id=73a60ee6396d4177a323b597444aec94, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.622341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d06e27-8e0e-4aa5-acf5-52df7c001ca0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.627520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535665d-f6d6-47f4-8551-dc04c51d61b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.628339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535665d-f6d6-47f4-8551-dc04c51d61b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.629090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535665d-f6d6-47f4-8551-dc04c51d61b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.629558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535665d-f6d6-47f4-8551-dc04c51d61b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.630375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535665d-f6d6-47f4-8551-dc04c51d61b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.633408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535665d-f6d6-47f4-8551-dc04c51d61b4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.652008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 774/1534] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:13 2022] PUT /identity/v3/projects/c92c518ee9dd4bc69381323ea696c3ad/users/73a60ee6396d4177a323b597444aec94/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:13.653228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d06e27-8e0e-4aa5-acf5-52df7c001ca0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.692459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 761/1535] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:13 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:13.696920 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535665d-f6d6-47f4-8551-dc04c51d61b4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.776844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:13.811137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d06e27-8e0e-4aa5-acf5-52df7c001ca0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.855676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535665d-f6d6-47f4-8551-dc04c51d61b4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.871672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dcd99-5a62-48f9-9fba-bcc3452b42bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.872299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dcd99-5a62-48f9-9fba-bcc3452b42bf admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.872572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dcd99-5a62-48f9-9fba-bcc3452b42bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.872843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dcd99-5a62-48f9-9fba-bcc3452b42bf admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.873504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399dcd99-5a62-48f9-9fba-bcc3452b42bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.875452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399dcd99-5a62-48f9-9fba-bcc3452b42bf admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.908188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 762/1536] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:13 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:00:13.913126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dcd99-5a62-48f9-9fba-bcc3452b42bf admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.939107 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dcd99-5a62-48f9-9fba-bcc3452b42bf admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:13.946847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6146f5-9324-4e0b-96bf-8cc7c9f6fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.947838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6146f5-9324-4e0b-96bf-8cc7c9f6fa51 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.947838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6146f5-9324-4e0b-96bf-8cc7c9f6fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.948083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6146f5-9324-4e0b-96bf-8cc7c9f6fa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.948696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6146f5-9324-4e0b-96bf-8cc7c9f6fa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.950377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6146f5-9324-4e0b-96bf-8cc7c9f6fa51 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.966669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 763/1537] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:13.970827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6146f5-9324-4e0b-96bf-8cc7c9f6fa51 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:13.974745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478523da-c516-419e-8ce2-e0c1490be830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:13.975493 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478523da-c516-419e-8ce2-e0c1490be830 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:13.975770 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478523da-c516-419e-8ce2-e0c1490be830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:13.976041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478523da-c516-419e-8ce2-e0c1490be830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:13.976759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478523da-c516-419e-8ce2-e0c1490be830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:13.978779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478523da-c516-419e-8ce2-e0c1490be830 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:13.982140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:13.995542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 775/1538] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:13.997374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6146f5-9324-4e0b-96bf-8cc7c9f6fa51 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:14.001123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478523da-c516-419e-8ce2-e0c1490be830 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:14.013024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920a82-c72e-41c6-84f5-f985bf09d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:14.018241 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478523da-c516-419e-8ce2-e0c1490be830 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:14.021068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920a82-c72e-41c6-84f5-f985bf09d760 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.021564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920a82-c72e-41c6-84f5-f985bf09d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.022048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920a82-c72e-41c6-84f5-f985bf09d760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.023163 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1512d-5091-402a-86c7-f9b667cc855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:14.023306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23920a82-c72e-41c6-84f5-f985bf09d760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:14.023968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1512d-5091-402a-86c7-f9b667cc855e admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.024455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1512d-5091-402a-86c7-f9b667cc855e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.024795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1512d-5091-402a-86c7-f9b667cc855e admin admin] PATH_INFO: `/v3/projects/c92c518ee9dd4bc69381323ea696c3ad/users/73a60ee6396d4177a323b597444aec94/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.027633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23920a82-c72e-41c6-84f5-f985bf09d760 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:14.027778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1512d-5091-402a-86c7-f9b667cc855e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92c518ee9dd4bc69381323ea696c3ad, user_id=73a60ee6396d4177a323b597444aec94, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:14.031288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1512d-5091-402a-86c7-f9b667cc855e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:14.063215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 764/1540] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:14.064379 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920a82-c72e-41c6-84f5-f985bf09d760 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:14.067724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 776/1540] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:13 2022] PUT /identity/v3/projects/c92c518ee9dd4bc69381323ea696c3ad/users/73a60ee6396d4177a323b597444aec94/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:14.069596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99644f-daeb-446c-944f-a25fc7c99c6f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.069997 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99644f-daeb-446c-944f-a25fc7c99c6f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.070363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99644f-daeb-446c-944f-a25fc7c99c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.089412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920a82-c72e-41c6-84f5-f985bf09d760 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:14.128303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4c99644f-daeb-446c-944f-a25fc7c99c6f None None] MFA Rules not processed for user `73a60ee6396d4177a323b597444aec94`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:14.130137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4c99644f-daeb-446c-944f-a25fc7c99c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:14.270362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 777/1541] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:14.281321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26efe15-e934-4529-83ee-bd400368213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:14.282084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26efe15-e934-4529-83ee-bd400368213e admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.282367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26efe15-e934-4529-83ee-bd400368213e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.282640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26efe15-e934-4529-83ee-bd400368213e admin admin] PATH_INFO: `/v3/projects/729b9f64d0b54667bf0b7feff802006c/users/71f3f7b234974bd0bbf8d8dfda1f3032/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.316749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26efe15-e934-4529-83ee-bd400368213e admin admin] RBAC: Authorizing `identity:create_grant(project_id=729b9f64d0b54667bf0b7feff802006c, user_id=71f3f7b234974bd0bbf8d8dfda1f3032, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:14.323507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26efe15-e934-4529-83ee-bd400368213e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:14.361394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 765/1542] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:14 2022] PUT /identity/v3/projects/729b9f64d0b54667bf0b7feff802006c/users/71f3f7b234974bd0bbf8d8dfda1f3032/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:14.361693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6cbf3-2fb8-41f8-a685-0ad324ec8009 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.362140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6cbf3-2fb8-41f8-a685-0ad324ec8009 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.362546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6cbf3-2fb8-41f8-a685-0ad324ec8009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.401901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e9d6cbf3-2fb8-41f8-a685-0ad324ec8009 None None] MFA Rules not processed for user `71f3f7b234974bd0bbf8d8dfda1f3032`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:14.403639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e9d6cbf3-2fb8-41f8-a685-0ad324ec8009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:14.487064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 778/1543] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:14.488459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26efe15-e934-4529-83ee-bd400368213e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:14.566808 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26efe15-e934-4529-83ee-bd400368213e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:14.573062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818381-0a3a-441c-b667-e72da4f9d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:14.573866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818381-0a3a-441c-b667-e72da4f9d931 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.574794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818381-0a3a-441c-b667-e72da4f9d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.575085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818381-0a3a-441c-b667-e72da4f9d931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.575721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818381-0a3a-441c-b667-e72da4f9d931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:14.578399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818381-0a3a-441c-b667-e72da4f9d931 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:14.616459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:14.628583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 766/1544] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:14 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:14.629904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6cbf3-2fb8-41f8-a685-0ad324ec8009 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:14.646065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6cbf3-2fb8-41f8-a685-0ad324ec8009 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:14.769900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64b5a6-d280-4467-a02f-5c01c7d6868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:14.770541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b5a6-d280-4467-a02f-5c01c7d6868e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.770821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b5a6-d280-4467-a02f-5c01c7d6868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.771092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64b5a6-d280-4467-a02f-5c01c7d6868e admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.773742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64b5a6-d280-4467-a02f-5c01c7d6868e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:14.777161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64b5a6-d280-4467-a02f-5c01c7d6868e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:14.788133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:14.808339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 779/1545] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:14 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:14.809570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818381-0a3a-441c-b667-e72da4f9d931 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:14.820296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818381-0a3a-441c-b667-e72da4f9d931 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:14.837664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab5b7-e9e4-4de9-9c02-4227de646148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:14.841103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab5b7-e9e4-4de9-9c02-4227de646148 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.841742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab5b7-e9e4-4de9-9c02-4227de646148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.842602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ab5b7-e9e4-4de9-9c02-4227de646148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.844908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ab5b7-e9e4-4de9-9c02-4227de646148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:14.849067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ab5b7-e9e4-4de9-9c02-4227de646148 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:14.877589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 767/1546] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:14.882701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64b5a6-d280-4467-a02f-5c01c7d6868e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:14.894315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64b5a6-d280-4467-a02f-5c01c7d6868e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:14.900235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7c9b8-1d67-4d43-95bc-0c3918aa67c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:14.901965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7c9b8-1d67-4d43-95bc-0c3918aa67c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:14.902344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7c9b8-1d67-4d43-95bc-0c3918aa67c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:14.902713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7c9b8-1d67-4d43-95bc-0c3918aa67c9 admin admin] PATH_INFO: `/v3/projects/2fa0030c536d4aef818d23a7b8aa1ce1/users/5597d46c79b14556a61bcb7ce1741809/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:14.923680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7c9b8-1d67-4d43-95bc-0c3918aa67c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa0030c536d4aef818d23a7b8aa1ce1, user_id=5597d46c79b14556a61bcb7ce1741809, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:14.927479 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7c9b8-1d67-4d43-95bc-0c3918aa67c9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:14.944768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 780/1547] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:14 2022] PUT /identity/v3/projects/2fa0030c536d4aef818d23a7b8aa1ce1/users/5597d46c79b14556a61bcb7ce1741809/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:14.949272 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab5b7-e9e4-4de9-9c02-4227de646148 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:14.962985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ab5b7-e9e4-4de9-9c02-4227de646148 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:15.068910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b04e34-e8c2-47ed-a5c8-941b7e9a66de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:15.069101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04e34-e8c2-47ed-a5c8-941b7e9a66de admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:15.069327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04e34-e8c2-47ed-a5c8-941b7e9a66de admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:15.070008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b04e34-e8c2-47ed-a5c8-941b7e9a66de admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:15.070683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b04e34-e8c2-47ed-a5c8-941b7e9a66de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:15.072639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b04e34-e8c2-47ed-a5c8-941b7e9a66de admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:15.105536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 768/1548] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:15.106520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7c9b8-1d67-4d43-95bc-0c3918aa67c9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:15.132897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7c9b8-1d67-4d43-95bc-0c3918aa67c9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:15.144915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:15.146850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:15.147368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:15.147845 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] PATH_INFO: `/v3/projects/2fa0030c536d4aef818d23a7b8aa1ce1/users/5597d46c79b14556a61bcb7ce1741809/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:15.152219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa0030c536d4aef818d23a7b8aa1ce1, user_id=5597d46c79b14556a61bcb7ce1741809, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:15.158988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:15.185535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 781/1549] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:15 2022] PUT /identity/v3/projects/2fa0030c536d4aef818d23a7b8aa1ce1/users/5597d46c79b14556a61bcb7ce1741809/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:15.192158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f9a4-2a72-4d54-a352-5a613e66a1c0 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:15.192446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f9a4-2a72-4d54-a352-5a613e66a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:15.192723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f9a4-2a72-4d54-a352-5a613e66a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:15.224076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-1d28f9a4-2a72-4d54-a352-5a613e66a1c0 None None] MFA Rules not processed for user `5597d46c79b14556a61bcb7ce1741809`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:15.226064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1d28f9a4-2a72-4d54-a352-5a613e66a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:15.322533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 769/1550] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:15.332689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:15.335018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:15.445874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2ccc0-439f-4003-b09e-898835bd8e58 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:15.450261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade71b83-45ee-4b4d-a880-8ca144448bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:15.451055 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71b83-45ee-4b4d-a880-8ca144448bff service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:15.451392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71b83-45ee-4b4d-a880-8ca144448bff service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:15.451670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade71b83-45ee-4b4d-a880-8ca144448bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:15.493500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f9a4-2a72-4d54-a352-5a613e66a1c0 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:15.505951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f9a4-2a72-4d54-a352-5a613e66a1c0 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:15.512882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:15.514160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:15.514160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:15.514160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:15.516129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:15.534364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade71b83-45ee-4b4d-a880-8ca144448bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:15.537126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade71b83-45ee-4b4d-a880-8ca144448bff service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:15.553126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 782/1551] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:15.595935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:15.597354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:15.609692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 770/1552] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:16.441435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade71b83-45ee-4b4d-a880-8ca144448bff service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:16.450811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade71b83-45ee-4b4d-a880-8ca144448bff service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:16.458277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2bb36-acd4-4ff9-a5e3-3056fda0018f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:16.458981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bb36-acd4-4ff9-a5e3-3056fda0018f service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:16.459270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bb36-acd4-4ff9-a5e3-3056fda0018f service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:16.459596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2bb36-acd4-4ff9-a5e3-3056fda0018f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:16.461901 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-aca2bb36-acd4-4ff9-a5e3-3056fda0018f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:16.616882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2bb36-acd4-4ff9-a5e3-3056fda0018f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:16.617300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2bb36-acd4-4ff9-a5e3-3056fda0018f service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:16.637193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 783/1553] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:16.659540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:16.679962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7a55c-8600-4266-9042-279dacd24ab1 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:16.694544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eb176-a5bf-4f2c-8bfb-13538a7d00a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:16.695191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb176-a5bf-4f2c-8bfb-13538a7d00a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:16.695972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb176-a5bf-4f2c-8bfb-13538a7d00a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:16.696248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eb176-a5bf-4f2c-8bfb-13538a7d00a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:16.707906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:16.846990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eb176-a5bf-4f2c-8bfb-13538a7d00a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:16.848571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eb176-a5bf-4f2c-8bfb-13538a7d00a4 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:16.887615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 771/1554] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:16.930550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dd90d-44e9-4d26-9f1f-f061e9fbafe0 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:16.930847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dd90d-44e9-4d26-9f1f-f061e9fbafe0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:16.931165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dd90d-44e9-4d26-9f1f-f061e9fbafe0 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:16.935187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 784/1555] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 13:00:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:00:16.966735 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db841-4313-4e3f-bc89-c2d760698873 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:16.967017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db841-4313-4e3f-bc89-c2d760698873 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:16.967205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db841-4313-4e3f-bc89-c2d760698873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:17.018784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-370db841-4313-4e3f-bc89-c2d760698873 None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:17.022367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-370db841-4313-4e3f-bc89-c2d760698873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:17.233506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 772/1556] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:17.640109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dd90d-44e9-4d26-9f1f-f061e9fbafe0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:17.644109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-919dd90d-44e9-4d26-9f1f-f061e9fbafe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:17.683711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:17.690412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dd90d-44e9-4d26-9f1f-f061e9fbafe0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:17.724216 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:17.725253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:17.725794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:17.727969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:17.757147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:17.764886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:17.797331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 785/1557] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:19.748882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db841-4313-4e3f-bc89-c2d760698873 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:19.758921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db841-4313-4e3f-bc89-c2d760698873 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:19.764518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e3e9-1fcb-4882-96c8-d5be0d4d2311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:19.766092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e3e9-1fcb-4882-96c8-d5be0d4d2311 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:19.766439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e3e9-1fcb-4882-96c8-d5be0d4d2311 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:19.766851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e3e9-1fcb-4882-96c8-d5be0d4d2311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:19.772986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:19.775076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:19.864595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f0f23-d403-4ae6-8ea3-97436693ed15 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:19.874612 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:19.875419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:19.875900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:19.876376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] PATH_INFO: `/v3/users/886edb72b3ee4d19a117590078a8a42e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:19.877788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] RBAC: Authorizing `identity:delete_user(user_id=886edb72b3ee4d19a117590078a8a42e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:19.888298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e3e9-1fcb-4882-96c8-d5be0d4d2311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:19.889745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e3e9-1fcb-4882-96c8-d5be0d4d2311 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:19.890603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:19.912289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 773/1558] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:19.958741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886edb72b3ee4d19a117590078a8a42e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:19.971069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886edb72b3ee4d19a117590078a8a42e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:19.971792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886edb72b3ee4d19a117590078a8a42e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:19.997341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886edb72b3ee4d19a117590078a8a42e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:19.998207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886edb72b3ee4d19a117590078a8a42e'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:20.020214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4841-851d-49de-b6a6-4a5c5a9958ca None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:20.021061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4841-851d-49de-b6a6-4a5c5a9958ca None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:20.021337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4841-851d-49de-b6a6-4a5c5a9958ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:20.024524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 786/1559] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:19 2022] DELETE /identity/v3/users/886edb72b3ee4d19a117590078a8a42e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:20.048636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a01a4841-851d-49de-b6a6-4a5c5a9958ca None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:20.050193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a01a4841-851d-49de-b6a6-4a5c5a9958ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:20.082850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:20.141073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 774/1560] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:20.158552 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:20.160350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:20.262664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b51e6-8e3d-4804-b8d4-7bc94113825a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:20.266826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c170c-cac4-420b-a038-e09747f17535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:20.267796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c170c-cac4-420b-a038-e09747f17535 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:20.268039 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c170c-cac4-420b-a038-e09747f17535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:20.268314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c170c-cac4-420b-a038-e09747f17535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:20.283938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c170c-cac4-420b-a038-e09747f17535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:20.287852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c170c-cac4-420b-a038-e09747f17535 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:20.318307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 787/1561] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:20.430473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a4841-851d-49de-b6a6-4a5c5a9958ca None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:20.432623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a01a4841-851d-49de-b6a6-4a5c5a9958ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:20.560419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a4841-851d-49de-b6a6-4a5c5a9958ca None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:20.565763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a60ee6396d4177a323b597444aec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c92c518ee9dd4bc69381323ea696c3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:20.566081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:20.566481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:20.566853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:20.567691 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:20.568038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:20.577672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:20.593120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 775/1562] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:20.594259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c170c-cac4-420b-a038-e09747f17535 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:20.606948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c170c-cac4-420b-a038-e09747f17535 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:20.616845 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:20.617086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381313c0-6574-4a66-ac86-1f1254846c33 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a60ee6396d4177a323b597444aec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c92c518ee9dd4bc69381323ea696c3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:20.617751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381313c0-6574-4a66-ac86-1f1254846c33 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:20.618131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381313c0-6574-4a66-ac86-1f1254846c33 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:20.618415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381313c0-6574-4a66-ac86-1f1254846c33 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:20.618702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:20.619059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381313c0-6574-4a66-ac86-1f1254846c33 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:20.622134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381313c0-6574-4a66-ac86-1f1254846c33 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:20.635962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:20.662695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 788/1563] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:20 2022] POST /identity/v3/projects => generated 354 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:00:20.666754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381313c0-6574-4a66-ac86-1f1254846c33 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:20.706391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacab55d-46a4-44f2-8065-ec0e39b2cfc2 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:20.757521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381313c0-6574-4a66-ac86-1f1254846c33 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:20.765139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a60ee6396d4177a323b597444aec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c92c518ee9dd4bc69381323ea696c3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:20.766677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:20.767175 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:20.767782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:20.768628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:20.769204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:20.775081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:20.775710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:20.776077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:20.776398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:20.778814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:20.788339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:20.808244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 789/1564] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:20.830686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:20.831707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:20.833086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:20.873226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:20.875050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:20.887376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 776/1565] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:20.888388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:20.900256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93412d45-12d5-45e5-9cb7-13eb4b60c73a service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:20.904889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a60ee6396d4177a323b597444aec94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c92c518ee9dd4bc69381323ea696c3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:20.905547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:20.905833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:20.906105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] PATH_INFO: `/v3/projects/956f0f52fac346ec98334c72cb0afb24` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:20.907289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Authorizing `identity:delete_project(project_id=956f0f52fac346ec98334c72cb0afb24)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:20.909351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:20.943606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a3918-9172-4c96-a71a-d67e01ba8038 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:20.950411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:20.951498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:20.951957 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:20.952436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] PATH_INFO: `/v3/projects/727dc293fe5748cda834b4bf68a18c1d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:20.953795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727dc293fe5748cda834b4bf68a18c1d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:20.955741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:20.983856 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956f0f52fac346ec98334c72cb0afb24', 'request_id': 'req-ab121350-df7e-4b61-b79e-1952b8ab2f66'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:20.996908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956f0f52fac346ec98334c72cb0afb24', 'request_id': 'req-ab121350-df7e-4b61-b79e-1952b8ab2f66'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.005430 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956f0f52fac346ec98334c72cb0afb24', 'request_id': 'req-ab121350-df7e-4b61-b79e-1952b8ab2f66'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.027776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727dc293fe5748cda834b4bf68a18c1d', 'request_id': 'req-683bc244-c7d2-4988-8f9d-084f08b73ed8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.027972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] The token cache is being invalidate because project 956f0f52fac346ec98334c72cb0afb24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:21.028174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.029139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.034803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 777/1566] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:20 2022] DELETE /identity/v3/projects/956f0f52fac346ec98334c72cb0afb24 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:21.034950 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727dc293fe5748cda834b4bf68a18c1d', 'request_id': 'req-683bc244-c7d2-4988-8f9d-084f08b73ed8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.046530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727dc293fe5748cda834b4bf68a18c1d', 'request_id': 'req-683bc244-c7d2-4988-8f9d-084f08b73ed8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.063779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] The token cache is being invalidate because project 727dc293fe5748cda834b4bf68a18c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:21.064076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.064746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.066455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 790/1567] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:20 2022] DELETE /identity/v3/projects/727dc293fe5748cda834b4bf68a18c1d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:21.074550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:21.076068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.156462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab121350-df7e-4b61-b79e-1952b8ab2f66 tempest-VolumeQuotaClassesTest-1780265049 tempest-VolumeQuotaClassesTest-1780265049-project-admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:21.243794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:21.244670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:21.245017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:21.245591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] PATH_INFO: `/v3/users/aaec62a0c3324b8abc749a291f42e49e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:21.246767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaec62a0c3324b8abc749a291f42e49e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:21.249292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:21.251957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:21.312475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:21.314125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.326325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaec62a0c3324b8abc749a291f42e49e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.336585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bc244-c7d2-4988-8f9d-084f08b73ed8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:21.343678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:21.344310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:21.344741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:21.345076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] PATH_INFO: `/v3/users/bf7479d80273467ea50bdd9a8b26f4dc` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:21.346376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7479d80273467ea50bdd9a8b26f4dc)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:21.348424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:21.348885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaec62a0c3324b8abc749a291f42e49e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.349815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaec62a0c3324b8abc749a291f42e49e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.361122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaec62a0c3324b8abc749a291f42e49e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.362619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:21.362811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaec62a0c3324b8abc749a291f42e49e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.381061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 778/1568] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:21 2022] DELETE /identity/v3/users/aaec62a0c3324b8abc749a291f42e49e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:21.384606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:21.384606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.418066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7479d80273467ea50bdd9a8b26f4dc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.443481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7479d80273467ea50bdd9a8b26f4dc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.445355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7479d80273467ea50bdd9a8b26f4dc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.457092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7479d80273467ea50bdd9a8b26f4dc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.457922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1987738-4e14-49f5-95c1-3b5976b80d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7479d80273467ea50bdd9a8b26f4dc'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.476548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 791/1569] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:21 2022] DELETE /identity/v3/users/bf7479d80273467ea50bdd9a8b26f4dc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:21.481064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b730f-96f5-4714-b238-db276326c9af None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:21.481637 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b730f-96f5-4714-b238-db276326c9af None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:21.481923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b730f-96f5-4714-b238-db276326c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:21.482850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ac04f-3b57-4298-ae9e-1e7e77f66991 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:21.504813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ee4b730f-96f5-4714-b238-db276326c9af None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:21.506598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ee4b730f-96f5-4714-b238-db276326c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.550111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:21.550890 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:21.551173 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:21.551922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] PATH_INFO: `/v3/users/1a1ab89ae7ec4a17b0989a202820cfc0` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:21.553364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1ab89ae7ec4a17b0989a202820cfc0)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:21.555750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:21.596928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:21.602462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 792/1570] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:21.613757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b730f-96f5-4714-b238-db276326c9af None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:21.615300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ee4b730f-96f5-4714-b238-db276326c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.620414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1ab89ae7ec4a17b0989a202820cfc0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.639972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1ab89ae7ec4a17b0989a202820cfc0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.640729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1ab89ae7ec4a17b0989a202820cfc0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.652343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1ab89ae7ec4a17b0989a202820cfc0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.653012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0166f3d6-a7b2-465f-ba67-b245a17db6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1ab89ae7ec4a17b0989a202820cfc0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.673380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 779/1571] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:21 2022] DELETE /identity/v3/users/1a1ab89ae7ec4a17b0989a202820cfc0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:21.677227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0293-ac08-44f0-8e00-e7acd73b3db2 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:21.677595 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0293-ac08-44f0-8e00-e7acd73b3db2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:21.677868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e0293-ac08-44f0-8e00-e7acd73b3db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:21.686704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b730f-96f5-4714-b238-db276326c9af None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:21.699854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-284e0293-ac08-44f0-8e00-e7acd73b3db2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:21.701110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-284e0293-ac08-44f0-8e00-e7acd73b3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.738787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:21.749042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:21.750093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:21.750850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:21.751576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:21.754357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.787530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 780/1572] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:21.788707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e0293-ac08-44f0-8e00-e7acd73b3db2 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:21.790199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-284e0293-ac08-44f0-8e00-e7acd73b3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.810864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e0293-ac08-44f0-8e00-e7acd73b3db2 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:21.841081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:21.841616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:21.842036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:21.842315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:21.842588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] PATH_INFO: `/v3/projects/b1e9d39cebba422eb23cc26a5e7d77d8` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:21.843027 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:21.843976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e9d39cebba422eb23cc26a5e7d77d8)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:21.846701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:21.855786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 793/1573] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:21.856528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:21.858526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:21.872858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dbcbc-972e-430c-a3d7-45b7ab4f2155 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:21.877778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2334e-f590-44cc-af18-b3cd710925e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:21.878479 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2334e-f590-44cc-af18-b3cd710925e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:21.878763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2334e-f590-44cc-af18-b3cd710925e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:21.879034 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2334e-f590-44cc-af18-b3cd710925e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:21.891354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2334e-f590-44cc-af18-b3cd710925e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:21.893346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2334e-f590-44cc-af18-b3cd710925e2 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:21.907048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 794/1574] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:21.916112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e9d39cebba422eb23cc26a5e7d77d8', 'request_id': 'req-b79a9175-192c-4746-a88b-8a6e1d08d8f3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.923202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e9d39cebba422eb23cc26a5e7d77d8', 'request_id': 'req-b79a9175-192c-4746-a88b-8a6e1d08d8f3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.931137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e9d39cebba422eb23cc26a5e7d77d8', 'request_id': 'req-b79a9175-192c-4746-a88b-8a6e1d08d8f3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.951889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] The token cache is being invalidate because project b1e9d39cebba422eb23cc26a5e7d77d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:21.952292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.952993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:21.957603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 781/1575] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:21 2022] DELETE /identity/v3/projects/b1e9d39cebba422eb23cc26a5e7d77d8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:21.958819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2334e-f590-44cc-af18-b3cd710925e2 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:21.970752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2334e-f590-44cc-af18-b3cd710925e2 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:22.047600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:22.049472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:22.050060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:22.050577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] PATH_INFO: `/v3/users/f6bc9f6ce2a343ed99eba54af33234ec` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:22.052542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bc9f6ce2a343ed99eba54af33234ec)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:22.055839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:22.174894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bc9f6ce2a343ed99eba54af33234ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.205447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bc9f6ce2a343ed99eba54af33234ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.206284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bc9f6ce2a343ed99eba54af33234ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.220549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bc9f6ce2a343ed99eba54af33234ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.222490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bc9f6ce2a343ed99eba54af33234ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.250443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:22.255647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 795/1576] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:21 2022] DELETE /identity/v3/users/f6bc9f6ce2a343ed99eba54af33234ec => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:22.474861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:22.477374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:22.507752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a9175-192c-4746-a88b-8a6e1d08d8f3 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:22.558788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:22.641309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:22.642090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:22.642476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:22.642817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] PATH_INFO: `/v3/projects/0cf6402a0dcf4cd9b79d2f2fb4769f08` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:22.644151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf6402a0dcf4cd9b79d2f2fb4769f08)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:22.647273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:22.796572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf6402a0dcf4cd9b79d2f2fb4769f08', 'request_id': 'req-74d2bfd0-bc71-47cc-9f72-4072006525c9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.808428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf6402a0dcf4cd9b79d2f2fb4769f08', 'request_id': 'req-74d2bfd0-bc71-47cc-9f72-4072006525c9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.820521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf6402a0dcf4cd9b79d2f2fb4769f08', 'request_id': 'req-74d2bfd0-bc71-47cc-9f72-4072006525c9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.844787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] The token cache is being invalidate because project 0cf6402a0dcf4cd9b79d2f2fb4769f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:22.845699 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.846593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:22.864092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 782/1577] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:22 2022] DELETE /identity/v3/projects/0cf6402a0dcf4cd9b79d2f2fb4769f08 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:22.870729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:22.872873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:22.878234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:22.880910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:22.917591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e103474-2272-4e39-93b8-f0f88906d776 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:23.008647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:23.009396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.009588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.009866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] PATH_INFO: `/v3/users/73a60ee6396d4177a323b597444aec94` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.011055 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a60ee6396d4177a323b597444aec94)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:23.013225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:23.049958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2bfd0-bc71-47cc-9f72-4072006525c9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:23.061661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:23.062353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.062643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.062932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] PATH_INFO: `/v3/projects/d07f640fe9f64a2abe4e9106318cb4c3` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.064218 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07f640fe9f64a2abe4e9106318cb4c3)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:23.066431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:23.087976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a60ee6396d4177a323b597444aec94'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.129419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a60ee6396d4177a323b597444aec94'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.130355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a60ee6396d4177a323b597444aec94'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.148161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a60ee6396d4177a323b597444aec94'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.149285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a60ee6396d4177a323b597444aec94'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.160537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07f640fe9f64a2abe4e9106318cb4c3', 'request_id': 'req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.168695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07f640fe9f64a2abe4e9106318cb4c3', 'request_id': 'req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.169396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 796/1578] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:22 2022] DELETE /identity/v3/users/73a60ee6396d4177a323b597444aec94 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:23.169970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:23.171614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:23.174389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:23.180658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07f640fe9f64a2abe4e9106318cb4c3', 'request_id': 'req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.202689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] The token cache is being invalidate because project d07f640fe9f64a2abe4e9106318cb4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:23.203144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.203945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.206045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 783/1579] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:22 2022] DELETE /identity/v3/projects/d07f640fe9f64a2abe4e9106318cb4c3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:23.209598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:23.211784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:23.266387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606211a9-2657-4845-8588-381d6c90a918 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:23.271619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:23.272286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.272567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.272840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] PATH_INFO: `/v3/projects/3731365e0025431aa2d9d5ede76e893d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.274379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3731365e0025431aa2d9d5ede76e893d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:23.276691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:23.302176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc0f6b-d3d4-4719-b0bd-6f87ef0882a8 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:23.302671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:23.310394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:23.311293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.311745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.312160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] PATH_INFO: `/v3/users/4e0149e5886a42ffbefd2dc7bf4ed21b` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.313603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0149e5886a42ffbefd2dc7bf4ed21b)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:23.315698 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:23.333324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3731365e0025431aa2d9d5ede76e893d', 'request_id': 'req-0351f1d3-9ded-4131-a2ab-ccdd33264476'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.340648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3731365e0025431aa2d9d5ede76e893d', 'request_id': 'req-0351f1d3-9ded-4131-a2ab-ccdd33264476'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.347575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3731365e0025431aa2d9d5ede76e893d', 'request_id': 'req-0351f1d3-9ded-4131-a2ab-ccdd33264476'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.365134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] The token cache is being invalidate because project 3731365e0025431aa2d9d5ede76e893d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:23.365921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.366726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0351f1d3-9ded-4131-a2ab-ccdd33264476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.368999 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 797/1580] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:23 2022] DELETE /identity/v3/projects/3731365e0025431aa2d9d5ede76e893d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:23.371983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0149e5886a42ffbefd2dc7bf4ed21b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.374680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64643422-ef98-4d90-8ab6-e5b2dd70ec21 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.374872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64643422-ef98-4d90-8ab6-e5b2dd70ec21 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.375141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64643422-ef98-4d90-8ab6-e5b2dd70ec21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.387091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0149e5886a42ffbefd2dc7bf4ed21b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.387839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0149e5886a42ffbefd2dc7bf4ed21b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.396664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0149e5886a42ffbefd2dc7bf4ed21b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.397730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d181f654-a830-4a72-87b3-54c8fe7c25ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0149e5886a42ffbefd2dc7bf4ed21b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:23.398462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-64643422-ef98-4d90-8ab6-e5b2dd70ec21 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:23.399719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-64643422-ef98-4d90-8ab6-e5b2dd70ec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:23.424370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 784/1581] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:23 2022] DELETE /identity/v3/users/4e0149e5886a42ffbefd2dc7bf4ed21b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:23.529671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 798/1582] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:23.531825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437244-963c-42ae-ad6c-88028735f998 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.532180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437244-963c-42ae-ad6c-88028735f998 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.532458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437244-963c-42ae-ad6c-88028735f998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.556701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a5437244-963c-42ae-ad6c-88028735f998 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:23.558770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a5437244-963c-42ae-ad6c-88028735f998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:23.650047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 785/1583] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:23.651963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64643422-ef98-4d90-8ab6-e5b2dd70ec21 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:23.664672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64643422-ef98-4d90-8ab6-e5b2dd70ec21 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:23.671816 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:23.672239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.672516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.672911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.673721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:23.674100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:23.676277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:23.694956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 799/1584] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:23.697892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437244-963c-42ae-ad6c-88028735f998 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:23.710479 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437244-963c-42ae-ad6c-88028735f998 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:23.717870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:23.718564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.719396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.719790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.721588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:23.723834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:23.731475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:23.759966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 786/1585] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:23 2022] POST /identity/v3/projects => generated 401 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:23.764843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:23.808165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e22b2-2d82-4d3b-a296-d8bf4019dbe8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:23.825168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:23.827281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:23.938132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038ecfe-d384-4365-994d-b7b9a17e646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:23.938757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038ecfe-d384-4365-994d-b7b9a17e646a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.939053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038ecfe-d384-4365-994d-b7b9a17e646a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.939299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038ecfe-d384-4365-994d-b7b9a17e646a admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.939954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038ecfe-d384-4365-994d-b7b9a17e646a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:23.942056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038ecfe-d384-4365-994d-b7b9a17e646a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:23.955439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310075b0-50fc-4220-8110-7484c4664e77 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:23.962694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:23.963554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:23.964012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:23.964422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] PATH_INFO: `/v3/projects/c92c518ee9dd4bc69381323ea696c3ad` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:23.965961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92c518ee9dd4bc69381323ea696c3ad)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:23.968505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:23.972852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 800/1586] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:23 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:23.986907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038ecfe-d384-4365-994d-b7b9a17e646a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.012924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038ecfe-d384-4365-994d-b7b9a17e646a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.054763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:24.060892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92c518ee9dd4bc69381323ea696c3ad', 'request_id': 'req-5f90862f-0311-40dc-9532-7c4b4902119b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.078127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92c518ee9dd4bc69381323ea696c3ad', 'request_id': 'req-5f90862f-0311-40dc-9532-7c4b4902119b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.095239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92c518ee9dd4bc69381323ea696c3ad', 'request_id': 'req-5f90862f-0311-40dc-9532-7c4b4902119b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.095559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.096136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.096419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.096678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.097665 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.099750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.114297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 801/1587] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:24.114297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.114297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.114633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] The token cache is being invalidate because project c92c518ee9dd4bc69381323ea696c3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:24.114993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.116056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.117817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 787/1588] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:23 2022] DELETE /identity/v3/projects/c92c518ee9dd4bc69381323ea696c3ad => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:24.118392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.120299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.128124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703072b5-6438-4359-9e1d-7349de0c6911 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.133037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.133831 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.133977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.134235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] PATH_INFO: `/v3/projects/94b9f014c6404bb4ba13cc196e0c1fde` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.134763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90862f-0311-40dc-9532-7c4b4902119b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.136168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b9f014c6404bb4ba13cc196e0c1fde)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.138140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.140946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378e005-99dc-4605-bebd-c1ffc9138622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.146353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e005-99dc-4605-bebd-c1ffc9138622 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.146353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e005-99dc-4605-bebd-c1ffc9138622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.146886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e005-99dc-4605-bebd-c1ffc9138622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.147888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378e005-99dc-4605-bebd-c1ffc9138622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.149968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378e005-99dc-4605-bebd-c1ffc9138622 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.169931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 788/1589] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:24.169931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7468-b8fb-46d7-8448-556d85156c56 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.169931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7468-b8fb-46d7-8448-556d85156c56 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.169931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c7468-b8fb-46d7-8448-556d85156c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.200555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b50c7468-b8fb-46d7-8448-556d85156c56 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:24.201856 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b50c7468-b8fb-46d7-8448-556d85156c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.206036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b9f014c6404bb4ba13cc196e0c1fde', 'request_id': 'req-b65c0d1a-f982-469a-a234-33b2ede11d44'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.223656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b9f014c6404bb4ba13cc196e0c1fde', 'request_id': 'req-b65c0d1a-f982-469a-a234-33b2ede11d44'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.238480 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b9f014c6404bb4ba13cc196e0c1fde', 'request_id': 'req-b65c0d1a-f982-469a-a234-33b2ede11d44'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.271571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] The token cache is being invalidate because project 94b9f014c6404bb4ba13cc196e0c1fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:24.271881 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.272560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.277342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 802/1590] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:24 2022] DELETE /identity/v3/projects/94b9f014c6404bb4ba13cc196e0c1fde => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:24.277342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.280210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.331903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 789/1591] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:24.333003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c7468-b8fb-46d7-8448-556d85156c56 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.335443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b50c7468-b8fb-46d7-8448-556d85156c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.355666 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c7468-b8fb-46d7-8448-556d85156c56 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.363222 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.364824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.365156 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.366041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] PATH_INFO: `/v3/users/f2d04955c6db423aae40b3406d2007c5` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.368179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d04955c6db423aae40b3406d2007c5)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.372847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.375609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:24.414372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0d1a-f982-469a-a234-33b2ede11d44 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.421971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044fb54-d585-4b95-a3be-01cddd3d3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.433519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fb54-d585-4b95-a3be-01cddd3d3f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.433519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fb54-d585-4b95-a3be-01cddd3d3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.433519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fb54-d585-4b95-a3be-01cddd3d3f20 admin admin] PATH_INFO: `/v3/projects/d7320ab20e664d04bdae9cee83fa6f5d/users/dfafaac7050f47e69c31e99d930ab1ea/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.438480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d04955c6db423aae40b3406d2007c5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.452886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d04955c6db423aae40b3406d2007c5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.453180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044fb54-d585-4b95-a3be-01cddd3d3f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7320ab20e664d04bdae9cee83fa6f5d, user_id=dfafaac7050f47e69c31e99d930ab1ea, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.453631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d04955c6db423aae40b3406d2007c5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.455973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044fb54-d585-4b95-a3be-01cddd3d3f20 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.462467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d04955c6db423aae40b3406d2007c5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.463787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ce5d2bc2-03b8-4a76-8a77-13703d5f06b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d04955c6db423aae40b3406d2007c5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:24.471156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 803/1592] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:24 2022] PUT /identity/v3/projects/d7320ab20e664d04bdae9cee83fa6f5d/users/dfafaac7050f47e69c31e99d930ab1ea/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:24.472422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6facdfa-2f35-41c7-b7af-9d421cf77cd0 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.472701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6facdfa-2f35-41c7-b7af-9d421cf77cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.472982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6facdfa-2f35-41c7-b7af-9d421cf77cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.483641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 790/1593] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:24 2022] DELETE /identity/v3/users/f2d04955c6db423aae40b3406d2007c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:24.486184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a61a-d349-441b-a9f9-66cc40511afa None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.486672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a61a-d349-441b-a9f9-66cc40511afa None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.487356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a61a-d349-441b-a9f9-66cc40511afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.499907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b6facdfa-2f35-41c7-b7af-9d421cf77cd0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:24.502666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b6facdfa-2f35-41c7-b7af-9d421cf77cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.546455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:24.549601 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-3e19a61a-d349-441b-a9f9-66cc40511afa None None] MFA Rules not processed for user `dfafaac7050f47e69c31e99d930ab1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:24.550859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3e19a61a-d349-441b-a9f9-66cc40511afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.605905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 804/1594] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:24.613659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6facdfa-2f35-41c7-b7af-9d421cf77cd0 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.623600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6facdfa-2f35-41c7-b7af-9d421cf77cd0 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.629146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.629959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.630242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.630513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.631172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:24.631475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.633081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.646605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 791/1595] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:24.654029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a61a-d349-441b-a9f9-66cc40511afa None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.654332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 805/1596] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:24.655308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.655737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3e19a61a-d349-441b-a9f9-66cc40511afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.667811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de749c6-d668-418b-bc89-a244de1155c0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.680903 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ca6e7-cb1f-486c-944e-0aac1618ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.681758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca6e7-cb1f-486c-944e-0aac1618ee81 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.682367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca6e7-cb1f-486c-944e-0aac1618ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.682367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca6e7-cb1f-486c-944e-0aac1618ee81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.682943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ca6e7-cb1f-486c-944e-0aac1618ee81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.686456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ca6e7-cb1f-486c-944e-0aac1618ee81 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.690811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a61a-d349-441b-a9f9-66cc40511afa None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.707426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3463-a4c7-4ba8-ba6c-8a73ff79f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.708062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3463-a4c7-4ba8-ba6c-8a73ff79f6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.708340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3463-a4c7-4ba8-ba6c-8a73ff79f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.708745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3463-a4c7-4ba8-ba6c-8a73ff79f6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.710217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e3463-a4c7-4ba8-ba6c-8a73ff79f6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.712149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e3463-a4c7-4ba8-ba6c-8a73ff79f6a4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.744741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 806/1597] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:24 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:24.745716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ca6e7-cb1f-486c-944e-0aac1618ee81 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.751059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 792/1598] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:24 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:24.753180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3463-a4c7-4ba8-ba6c-8a73ff79f6a4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.850664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:24.851645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ca6e7-cb1f-486c-944e-0aac1618ee81 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.887967 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3463-a4c7-4ba8-ba6c-8a73ff79f6a4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.906590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.907286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.907590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.907852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.908565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:24.911302 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:24.945558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 793/1599] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:24 2022] POST /identity/v3/users => generated 307 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:24.947006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:24.953981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:24.995114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b23c3-4b51-4fdb-8147-39cbdfcc0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:24.995747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b23c3-4b51-4fdb-8147-39cbdfcc0fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:24.996017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6005f-36e6-4ca1-8672-d3d5d41e219d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:24.996153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b23c3-4b51-4fdb-8147-39cbdfcc0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:24.996282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b23c3-4b51-4fdb-8147-39cbdfcc0fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:24.998441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b23c3-4b51-4fdb-8147-39cbdfcc0fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.000399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b23c3-4b51-4fdb-8147-39cbdfcc0fd8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.000901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.001579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.001864 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.002136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] PATH_INFO: `/v3/projects/bd8f48e13a6b4ac086efb67182524d9c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.003955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8f48e13a6b4ac086efb67182524d9c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.005922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.050739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 807/1600] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:24 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:25.050739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b23c3-4b51-4fdb-8147-39cbdfcc0fd8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.075939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b23c3-4b51-4fdb-8147-39cbdfcc0fd8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.148597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8f48e13a6b4ac086efb67182524d9c', 'request_id': 'req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:25.156356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8f48e13a6b4ac086efb67182524d9c', 'request_id': 'req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:25.165459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8f48e13a6b4ac086efb67182524d9c', 'request_id': 'req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:25.183945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:25.196660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] The token cache is being invalidate because project bd8f48e13a6b4ac086efb67182524d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:25.197999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:25.202790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:25.211688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 794/1601] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:24 2022] DELETE /identity/v3/projects/bd8f48e13a6b4ac086efb67182524d9c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:25.212705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.215036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:25.256493 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d7232-4a84-4401-a362-33fdeb649234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.258404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7232-4a84-4401-a362-33fdeb649234 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.258879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7232-4a84-4401-a362-33fdeb649234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.259388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d7232-4a84-4401-a362-33fdeb649234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.260671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d7232-4a84-4401-a362-33fdeb649234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.263674 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d7232-4a84-4401-a362-33fdeb649234 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.288310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 808/1602] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:25.290068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6234c5-3da3-4fe3-a614-4d156e1c0082 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.290355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6234c5-3da3-4fe3-a614-4d156e1c0082 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.290628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6234c5-3da3-4fe3-a614-4d156e1c0082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.311727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fa6234c5-3da3-4fe3-a614-4d156e1c0082 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:25.312913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fa6234c5-3da3-4fe3-a614-4d156e1c0082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:25.313322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ccd3d-1700-4ef3-a967-d6681fc9b0eb admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.318380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadf8f8-650f-4f9a-a65b-9e53b6314e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.319102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadf8f8-650f-4f9a-a65b-9e53b6314e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.319487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadf8f8-650f-4f9a-a65b-9e53b6314e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.319827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadf8f8-650f-4f9a-a65b-9e53b6314e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.320549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadf8f8-650f-4f9a-a65b-9e53b6314e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.321352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 809/1603] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:25.322110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6234c5-3da3-4fe3-a614-4d156e1c0082 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.323939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fa6234c5-3da3-4fe3-a614-4d156e1c0082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:25.327161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadf8f8-650f-4f9a-a65b-9e53b6314e1b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.335926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6234c5-3da3-4fe3-a614-4d156e1c0082 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.341612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 795/1604] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:25.341612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf7fa-9cf6-4701-bd45-d7b179bc15cd None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.341612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf7fa-9cf6-4701-bd45-d7b179bc15cd None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.341612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf7fa-9cf6-4701-bd45-d7b179bc15cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.344237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e3bfd-ebd4-469d-92a8-151428dc2f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.344979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e3bfd-ebd4-469d-92a8-151428dc2f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.345354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e3bfd-ebd4-469d-92a8-151428dc2f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.345655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e3bfd-ebd4-469d-92a8-151428dc2f90 admin admin] PATH_INFO: `/v3/projects/d913ed9382114c0493ed36075b522ff0/users/ec65655006c349e2b8e44c7c195be8dc/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.363054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e3bfd-ebd4-469d-92a8-151428dc2f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d913ed9382114c0493ed36075b522ff0, user_id=ec65655006c349e2b8e44c7c195be8dc, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.363260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-4a2cf7fa-9cf6-4701-bd45-d7b179bc15cd None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:25.364522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4a2cf7fa-9cf6-4701-bd45-d7b179bc15cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:25.366036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e3bfd-ebd4-469d-92a8-151428dc2f90 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.374451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 796/1605] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:25.375842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cf7fa-9cf6-4701-bd45-d7b179bc15cd None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.386475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 810/1606] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:25 2022] PUT /identity/v3/projects/d913ed9382114c0493ed36075b522ff0/users/ec65655006c349e2b8e44c7c195be8dc/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:25.389439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cf7fa-9cf6-4701-bd45-d7b179bc15cd None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.390678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e3bfd-ebd4-469d-92a8-151428dc2f90 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.457562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:25.479665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e419b-b344-4d3c-9d23-e513b10fab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.480298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e419b-b344-4d3c-9d23-e513b10fab59 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.480579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e419b-b344-4d3c-9d23-e513b10fab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.480844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e419b-b344-4d3c-9d23-e513b10fab59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.481535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e419b-b344-4d3c-9d23-e513b10fab59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.483888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e419b-b344-4d3c-9d23-e513b10fab59 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.492446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e3bfd-ebd4-469d-92a8-151428dc2f90 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.499511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.500343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.500642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.501024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.501827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:25.502231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.503964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.520528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 797/1607] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:25.520528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e419b-b344-4d3c-9d23-e513b10fab59 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.524536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 811/1608] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:25.526078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.539107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cace14d-d0f6-492d-bd31-99c0a90bffb1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.544906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691934-3f1a-475c-ab18-6bd3d0f9a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.545971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691934-3f1a-475c-ab18-6bd3d0f9a1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.546478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691934-3f1a-475c-ab18-6bd3d0f9a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.546829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691934-3f1a-475c-ab18-6bd3d0f9a1d6 admin admin] PATH_INFO: `/v3/projects/72e7456fac514a2b923c54d64f91ee17/users/9b5cfcf7d1ca4b6f85309e8c97c2302c/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.549524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e419b-b344-4d3c-9d23-e513b10fab59 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.558465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127553a9-6655-4865-b51a-f1d7c531f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.559094 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127553a9-6655-4865-b51a-f1d7c531f330 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.559426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127553a9-6655-4865-b51a-f1d7c531f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.559627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127553a9-6655-4865-b51a-f1d7c531f330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.560382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127553a9-6655-4865-b51a-f1d7c531f330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.562439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127553a9-6655-4865-b51a-f1d7c531f330 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.567569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66691934-3f1a-475c-ab18-6bd3d0f9a1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e7456fac514a2b923c54d64f91ee17, user_id=9b5cfcf7d1ca4b6f85309e8c97c2302c, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.571369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66691934-3f1a-475c-ab18-6bd3d0f9a1d6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.581294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 798/1609] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:25.581294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127553a9-6655-4865-b51a-f1d7c531f330 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.593739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127553a9-6655-4865-b51a-f1d7c531f330 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.603355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 812/1610] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:25 2022] PUT /identity/v3/projects/72e7456fac514a2b923c54d64f91ee17/users/9b5cfcf7d1ca4b6f85309e8c97c2302c/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:25.603355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691934-3f1a-475c-ab18-6bd3d0f9a1d6 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.691572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d95ee-6939-43d8-8eb5-fcc6a2fabdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.692646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d95ee-6939-43d8-8eb5-fcc6a2fabdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.693467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d95ee-6939-43d8-8eb5-fcc6a2fabdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.693467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d95ee-6939-43d8-8eb5-fcc6a2fabdb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.695520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d95ee-6939-43d8-8eb5-fcc6a2fabdb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.699009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d95ee-6939-43d8-8eb5-fcc6a2fabdb8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.743915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 799/1611] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:25 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:25.743915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78581d39-b842-4729-b2be-dcdfb1e1d15d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.743915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78581d39-b842-4729-b2be-dcdfb1e1d15d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.745125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78581d39-b842-4729-b2be-dcdfb1e1d15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.749646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691934-3f1a-475c-ab18-6bd3d0f9a1d6 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.762138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:25.789018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-78581d39-b842-4729-b2be-dcdfb1e1d15d None None] MFA Rules not processed for user `9b5cfcf7d1ca4b6f85309e8c97c2302c`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:25.790293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-78581d39-b842-4729-b2be-dcdfb1e1d15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:25.863964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a67f5-f6f5-4adf-9fb6-c6b3f274b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.864636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a67f5-f6f5-4adf-9fb6-c6b3f274b354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.864913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a67f5-f6f5-4adf-9fb6-c6b3f274b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.865186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a67f5-f6f5-4adf-9fb6-c6b3f274b354 admin admin] PATH_INFO: `/v3/projects/d913ed9382114c0493ed36075b522ff0/users/ec65655006c349e2b8e44c7c195be8dc/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.870778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a67f5-f6f5-4adf-9fb6-c6b3f274b354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d913ed9382114c0493ed36075b522ff0, user_id=ec65655006c349e2b8e44c7c195be8dc, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.874142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a67f5-f6f5-4adf-9fb6-c6b3f274b354 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:25.885448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 813/1612] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:25 2022] PUT /identity/v3/projects/d913ed9382114c0493ed36075b522ff0/users/ec65655006c349e2b8e44c7c195be8dc/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:25.894544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a67f5-f6f5-4adf-9fb6-c6b3f274b354 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:25.904148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 800/1613] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:25.904148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a380f-e8dd-4273-9e17-9658c81c1605 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.904148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a380f-e8dd-4273-9e17-9658c81c1605 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.904148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a380f-e8dd-4273-9e17-9658c81c1605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.935658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9c3a380f-e8dd-4273-9e17-9658c81c1605 None None] MFA Rules not processed for user `ec65655006c349e2b8e44c7c195be8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:25.936915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9c3a380f-e8dd-4273-9e17-9658c81c1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:25.981284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a67f5-f6f5-4adf-9fb6-c6b3f274b354 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:25.983609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:25.988659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686fda-4a72-4f4c-9324-8ffe82a91bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:25.989289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686fda-4a72-4f4c-9324-8ffe82a91bae admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:25.989632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686fda-4a72-4f4c-9324-8ffe82a91bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:25.990230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686fda-4a72-4f4c-9324-8ffe82a91bae admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:25.990877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07686fda-4a72-4f4c-9324-8ffe82a91bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:25.993137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07686fda-4a72-4f4c-9324-8ffe82a91bae admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.024531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 814/1614] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:25 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:26.025136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686fda-4a72-4f4c-9324-8ffe82a91bae admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.033464 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 801/1615] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:25 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:26.034392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a380f-e8dd-4273-9e17-9658c81c1605 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.036283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686fda-4a72-4f4c-9324-8ffe82a91bae admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.042352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.043122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.043526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.043807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.044446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.046616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.057447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a380f-e8dd-4273-9e17-9658c81c1605 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.062630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c681-7455-4941-9230-26bc4998ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.063628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c681-7455-4941-9230-26bc4998ac97 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.064115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c681-7455-4941-9230-26bc4998ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.064644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236c681-7455-4941-9230-26bc4998ac97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.065425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236c681-7455-4941-9230-26bc4998ac97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.067419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236c681-7455-4941-9230-26bc4998ac97 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.080260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 815/1616] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:26 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:26.081593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.083675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.085098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 802/1617] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:26.086359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c681-7455-4941-9230-26bc4998ac97 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.099734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236c681-7455-4941-9230-26bc4998ac97 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.146813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428cf31-601f-4d06-a068-0f1d30267165 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.151851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d032e-59a6-41d2-877b-8812f273396f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.152873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d032e-59a6-41d2-877b-8812f273396f service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.153306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d032e-59a6-41d2-877b-8812f273396f service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.154009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d032e-59a6-41d2-877b-8812f273396f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.160516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dafd02-d37c-439f-8602-ff3da6f58998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.160936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dafd02-d37c-439f-8602-ff3da6f58998 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.161210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dafd02-d37c-439f-8602-ff3da6f58998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.161500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dafd02-d37c-439f-8602-ff3da6f58998 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.162228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dafd02-d37c-439f-8602-ff3da6f58998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.164390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dafd02-d37c-439f-8602-ff3da6f58998 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.187438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:26.197192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 803/1618] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:26 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:26.198645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dafd02-d37c-439f-8602-ff3da6f58998 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.216337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dafd02-d37c-439f-8602-ff3da6f58998 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.221372 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d506d-ecae-433f-b8a0-6692873ed976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.222012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d506d-ecae-433f-b8a0-6692873ed976 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.222289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d506d-ecae-433f-b8a0-6692873ed976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.222652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d506d-ecae-433f-b8a0-6692873ed976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.223206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d506d-ecae-433f-b8a0-6692873ed976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.224804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d506d-ecae-433f-b8a0-6692873ed976 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.236672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d032e-59a6-41d2-877b-8812f273396f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.236861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 804/1619] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:26.238606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d032e-59a6-41d2-877b-8812f273396f service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.240583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d506d-ecae-433f-b8a0-6692873ed976 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.250850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d506d-ecae-433f-b8a0-6692873ed976 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.256783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348c8d2-7802-4285-ba6b-91c739e7e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.257859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348c8d2-7802-4285-ba6b-91c739e7e10c admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.258207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348c8d2-7802-4285-ba6b-91c739e7e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.258546 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348c8d2-7802-4285-ba6b-91c739e7e10c admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.259295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348c8d2-7802-4285-ba6b-91c739e7e10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.259870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 816/1620] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:26.261556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d032e-59a6-41d2-877b-8812f273396f service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.261674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348c8d2-7802-4285-ba6b-91c739e7e10c admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.275047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d032e-59a6-41d2-877b-8812f273396f service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.277119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 805/1621] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:26.277824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348c8d2-7802-4285-ba6b-91c739e7e10c admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.283055 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab48b79-85f0-47a2-a361-dc833dcc7848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.284650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48b79-85f0-47a2-a361-dc833dcc7848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.284995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48b79-85f0-47a2-a361-dc833dcc7848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.285376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48b79-85f0-47a2-a361-dc833dcc7848 admin admin] PATH_INFO: `/v3/projects/010f41f3f7dc4226a26085b43500ca26/users/5e1fc907c07448c69de3c11236dfc8c9/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.288706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348c8d2-7802-4285-ba6b-91c739e7e10c admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.296661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31938d-0fa6-4657-82e9-dd75a22220ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.297658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31938d-0fa6-4657-82e9-dd75a22220ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.298131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31938d-0fa6-4657-82e9-dd75a22220ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.298474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31938d-0fa6-4657-82e9-dd75a22220ac admin admin] PATH_INFO: `/v3/projects/94db14b5828341748bdb72ef3a932470/users/8497d2b776494759848caecc6b03f787/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.309087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab48b79-85f0-47a2-a361-dc833dcc7848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010f41f3f7dc4226a26085b43500ca26, user_id=5e1fc907c07448c69de3c11236dfc8c9, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.314976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab48b79-85f0-47a2-a361-dc833dcc7848 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.315557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31938d-0fa6-4657-82e9-dd75a22220ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=94db14b5828341748bdb72ef3a932470, user_id=8497d2b776494759848caecc6b03f787, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.318765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31938d-0fa6-4657-82e9-dd75a22220ac admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.338947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 806/1622] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:26 2022] PUT /identity/v3/projects/94db14b5828341748bdb72ef3a932470/users/8497d2b776494759848caecc6b03f787/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:26.342974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31938d-0fa6-4657-82e9-dd75a22220ac admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.346625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 817/1623] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:26 2022] PUT /identity/v3/projects/010f41f3f7dc4226a26085b43500ca26/users/5e1fc907c07448c69de3c11236dfc8c9/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:26.360466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ff95-ddbe-41f5-8851-e3d94728fe62 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.360946 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ff95-ddbe-41f5-8851-e3d94728fe62 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.361311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9ff95-ddbe-41f5-8851-e3d94728fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.404165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-00f9ff95-ddbe-41f5-8851-e3d94728fe62 None None] MFA Rules not processed for user `5e1fc907c07448c69de3c11236dfc8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:26.406236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-00f9ff95-ddbe-41f5-8851-e3d94728fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.437168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31938d-0fa6-4657-82e9-dd75a22220ac admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.442493 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.443104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.443378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.443643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.444288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.445912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.461556 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 807/1624] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:26.461556 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.461556 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.470671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:26.477759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b430d0-bbe6-4bdb-86aa-7ee014973d79 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.483047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.483745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.484356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.484693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] PATH_INFO: `/v3/users/71f3f7b234974bd0bbf8d8dfda1f3032` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.485966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f3f7b234974bd0bbf8d8dfda1f3032)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.487950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.490442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 818/1625] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:26.491515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9ff95-ddbe-41f5-8851-e3d94728fe62 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.536731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f3f7b234974bd0bbf8d8dfda1f3032'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:26.549258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f3f7b234974bd0bbf8d8dfda1f3032'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:26.549968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f3f7b234974bd0bbf8d8dfda1f3032'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:26.551979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9ff95-ddbe-41f5-8851-e3d94728fe62 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.556520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b819398-16c7-493a-ad7a-171dfc9f352b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.557683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819398-16c7-493a-ad7a-171dfc9f352b service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.558005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f3f7b234974bd0bbf8d8dfda1f3032'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:26.558109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819398-16c7-493a-ad7a-171dfc9f352b service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.558315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819398-16c7-493a-ad7a-171dfc9f352b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.558770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f3f7b234974bd0bbf8d8dfda1f3032'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:26.560378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2b819398-16c7-493a-ad7a-171dfc9f352b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.574652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 808/1626] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:26 2022] DELETE /identity/v3/users/71f3f7b234974bd0bbf8d8dfda1f3032 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:26.574652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.574652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.609407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:26.628937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b819398-16c7-493a-ad7a-171dfc9f352b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.630579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b819398-16c7-493a-ad7a-171dfc9f352b service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.644635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 819/1627] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:26.645564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77e4af-78f4-4b76-beed-4094d0e80c61 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.646001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fa7d9-fb5a-44f3-8e1f-95bb4dcf5c27 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.646289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fa7d9-fb5a-44f3-8e1f-95bb4dcf5c27 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.646548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fa7d9-fb5a-44f3-8e1f-95bb4dcf5c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.652421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f86b7b-8e4c-4d7e-bc03-7b9764e4ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.653122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f86b7b-8e4c-4d7e-bc03-7b9764e4ea27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.653400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f86b7b-8e4c-4d7e-bc03-7b9764e4ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.653984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f86b7b-8e4c-4d7e-bc03-7b9764e4ea27 admin admin] PATH_INFO: `/v3/projects/94db14b5828341748bdb72ef3a932470/users/8497d2b776494759848caecc6b03f787/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.655969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f86b7b-8e4c-4d7e-bc03-7b9764e4ea27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94db14b5828341748bdb72ef3a932470, user_id=8497d2b776494759848caecc6b03f787, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.659138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f86b7b-8e4c-4d7e-bc03-7b9764e4ea27 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.673506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 809/1628] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:26 2022] PUT /identity/v3/projects/94db14b5828341748bdb72ef3a932470/users/8497d2b776494759848caecc6b03f787/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:26.686040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6837-2878-4eeb-9c6a-81fc4a74b001 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.686660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6837-2878-4eeb-9c6a-81fc4a74b001 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.687213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6837-2878-4eeb-9c6a-81fc4a74b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.695475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e36fa7d9-fb5a-44f3-8e1f-95bb4dcf5c27 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:26.697230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e36fa7d9-fb5a-44f3-8e1f-95bb4dcf5c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.739938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-869e6837-2878-4eeb-9c6a-81fc4a74b001 None None] MFA Rules not processed for user `8497d2b776494759848caecc6b03f787`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:26.741149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-869e6837-2878-4eeb-9c6a-81fc4a74b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.818907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 820/1629] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:26.824675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fa7d9-fb5a-44f3-8e1f-95bb4dcf5c27 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.826323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e36fa7d9-fb5a-44f3-8e1f-95bb4dcf5c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.838143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:26.863509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 810/1630] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:26.863509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e6837-2878-4eeb-9c6a-81fc4a74b001 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:26.863509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-869e6837-2878-4eeb-9c6a-81fc4a74b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.919740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fa7d9-fb5a-44f3-8e1f-95bb4dcf5c27 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.934629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.935340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.935615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.935893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.940262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:26.954943 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e6837-2878-4eeb-9c6a-81fc4a74b001 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:26.960650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:26.961269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:26.961576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:26.961858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:26.973691 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:26.975746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:26.995742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 811/1631] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:27.061038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:27.062845 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:27.077402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 821/1632] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:27.179941 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:27.181593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:27.208634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d5f8f-5429-4832-84e0-2e194dc76e43 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:27.230619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:27.231245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:27.235438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:27.235743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:27.272647 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:27.276408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:27.304415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 812/1633] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:27.438011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:27.453449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3cfd0-c266-4052-bca6-4dd0de50ba1b service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:27.461188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:27.462023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:27.462308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:27.463129 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:27.466098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:27.563586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:27.594735 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:27.598137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:27.614083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:27.615832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:27.626093 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395d5df-8010-476f-8c0a-3897c6909926 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:27.639880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 822/1634] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:27.646650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:27.647370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:27.647706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:27.647983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] PATH_INFO: `/v3/projects/729b9f64d0b54667bf0b7feff802006c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:27.649221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729b9f64d0b54667bf0b7feff802006c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:27.651294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:27.720178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729b9f64d0b54667bf0b7feff802006c', 'request_id': 'req-7dcb561e-b6fd-4585-8c84-153d73730030'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.726293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729b9f64d0b54667bf0b7feff802006c', 'request_id': 'req-7dcb561e-b6fd-4585-8c84-153d73730030'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.734415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729b9f64d0b54667bf0b7feff802006c', 'request_id': 'req-7dcb561e-b6fd-4585-8c84-153d73730030'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.751787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] The token cache is being invalidate because project 729b9f64d0b54667bf0b7feff802006c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:27.752226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.753271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.758346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 813/1635] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:27 2022] DELETE /identity/v3/projects/729b9f64d0b54667bf0b7feff802006c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:27.760436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:27.776173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230e0ff-301a-4c72-986d-dd6c7d205dba service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:27.848831 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:27.849471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:27.849795 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:27.850069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] PATH_INFO: `/v3/users/5597d46c79b14556a61bcb7ce1741809` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:27.851617 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5597d46c79b14556a61bcb7ce1741809)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:27.853629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:27.911989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5597d46c79b14556a61bcb7ce1741809'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.928240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5597d46c79b14556a61bcb7ce1741809'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.929464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5597d46c79b14556a61bcb7ce1741809'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.939379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5597d46c79b14556a61bcb7ce1741809'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.940193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ec49285f-a87f-41df-a508-6749deb844bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5597d46c79b14556a61bcb7ce1741809'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:27.967733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 823/1636] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:27 2022] DELETE /identity/v3/users/5597d46c79b14556a61bcb7ce1741809 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:28.374572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:28.376290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:28.403972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb561e-b6fd-4585-8c84-153d73730030 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:28.468340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:28.468981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:28.469276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:28.469583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] PATH_INFO: `/v3/projects/2fa0030c536d4aef818d23a7b8aa1ce1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:28.470731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa0030c536d4aef818d23a7b8aa1ce1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:28.472829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:28.482321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:28.535683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa0030c536d4aef818d23a7b8aa1ce1', 'request_id': 'req-ff0245f8-0273-40dc-a251-2898f6105e90'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:28.541911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa0030c536d4aef818d23a7b8aa1ce1', 'request_id': 'req-ff0245f8-0273-40dc-a251-2898f6105e90'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:28.549084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa0030c536d4aef818d23a7b8aa1ce1', 'request_id': 'req-ff0245f8-0273-40dc-a251-2898f6105e90'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:28.562913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] The token cache is being invalidate because project 2fa0030c536d4aef818d23a7b8aa1ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:28.563205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:28.570103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ff0245f8-0273-40dc-a251-2898f6105e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:28.573464 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 814/1637] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:28 2022] DELETE /identity/v3/projects/2fa0030c536d4aef818d23a7b8aa1ce1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:28.579634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc83c8-e987-4425-9e3a-f52b473789ec None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:28.580660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc83c8-e987-4425-9e3a-f52b473789ec None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:28.581765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc83c8-e987-4425-9e3a-f52b473789ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:28.604767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-82bc83c8-e987-4425-9e3a-f52b473789ec None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:28.606132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-82bc83c8-e987-4425-9e3a-f52b473789ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:28.686403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:28.715691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 824/1638] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:28.718298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfa7d-bd79-4367-ad46-14d99afa3a4b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:28.718688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfa7d-bd79-4367-ad46-14d99afa3a4b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:28.718914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfa7d-bd79-4367-ad46-14d99afa3a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:28.745666 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5afcfa7d-bd79-4367-ad46-14d99afa3a4b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:28.746996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5afcfa7d-bd79-4367-ad46-14d99afa3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:28.762998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 815/1639] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:28.765298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc83c8-e987-4425-9e3a-f52b473789ec None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:28.776953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc83c8-e987-4425-9e3a-f52b473789ec None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:28.783547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:28.784068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:28.784359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:28.784858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:28.785703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:28.786194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:28.788609 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:28.806190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 825/1640] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:28.808309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfa7d-bd79-4367-ad46-14d99afa3a4b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:28.821802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfa7d-bd79-4367-ad46-14d99afa3a4b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:28.827790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31676bc-bfb5-49ca-9cc2-3246f7827759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:28.830387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31676bc-bfb5-49ca-9cc2-3246f7827759 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:28.830673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31676bc-bfb5-49ca-9cc2-3246f7827759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:28.830948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31676bc-bfb5-49ca-9cc2-3246f7827759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:28.831750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31676bc-bfb5-49ca-9cc2-3246f7827759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:28.834015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31676bc-bfb5-49ca-9cc2-3246f7827759 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:28.885426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 816/1641] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:28 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:00:28.889991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:28.907240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8df87-c7c8-49cc-bdf1-5309ee7cdf55 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:28.995355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bd536-7bde-4144-a19e-7c790e376f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:28.995975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd536-7bde-4144-a19e-7c790e376f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:28.996256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd536-7bde-4144-a19e-7c790e376f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:28.996527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bd536-7bde-4144-a19e-7c790e376f6e admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:28.997165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bd536-7bde-4144-a19e-7c790e376f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:28.999229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bd536-7bde-4144-a19e-7c790e376f6e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.025465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 826/1642] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:28 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:29.027491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31676bc-bfb5-49ca-9cc2-3246f7827759 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:29.038031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31676bc-bfb5-49ca-9cc2-3246f7827759 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:29.043926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af9297-9c69-4c62-8146-52e496a7c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:29.044605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9297-9c69-4c62-8146-52e496a7c40e admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.044881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9297-9c69-4c62-8146-52e496a7c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.045159 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9297-9c69-4c62-8146-52e496a7c40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.045937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af9297-9c69-4c62-8146-52e496a7c40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:29.049996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af9297-9c69-4c62-8146-52e496a7c40e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.066192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 817/1643] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:29.067725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bd536-7bde-4144-a19e-7c790e376f6e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:29.078697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bd536-7bde-4144-a19e-7c790e376f6e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:29.083802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e020b-d35c-4832-ac13-ea3793a825c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:29.084529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e020b-d35c-4832-ac13-ea3793a825c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.085030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e020b-d35c-4832-ac13-ea3793a825c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.085578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e020b-d35c-4832-ac13-ea3793a825c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.086188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e020b-d35c-4832-ac13-ea3793a825c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:29.094427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e020b-d35c-4832-ac13-ea3793a825c3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.101833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 827/1644] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:29.105949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af9297-9c69-4c62-8146-52e496a7c40e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:29.119192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af9297-9c69-4c62-8146-52e496a7c40e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:29.125243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a06e-e7b6-4fba-a251-3a161845f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:29.126070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a06e-e7b6-4fba-a251-3a161845f6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.126416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a06e-e7b6-4fba-a251-3a161845f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.126753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a06e-e7b6-4fba-a251-3a161845f6f1 admin admin] PATH_INFO: `/v3/projects/a3a10c7633864082a677ded8aa423fc9/users/04fd3ce020bb41dba50e9c4a2902b1a2/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.144744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164a06e-e7b6-4fba-a251-3a161845f6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a10c7633864082a677ded8aa423fc9, user_id=04fd3ce020bb41dba50e9c4a2902b1a2, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:29.147588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164a06e-e7b6-4fba-a251-3a161845f6f1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.165948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 818/1645] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:29 2022] PUT /identity/v3/projects/a3a10c7633864082a677ded8aa423fc9/users/04fd3ce020bb41dba50e9c4a2902b1a2/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:29.177727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862e6f-c133-42c9-9760-f577cce2a876 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.178085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862e6f-c133-42c9-9760-f577cce2a876 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.178525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03862e6f-c133-42c9-9760-f577cce2a876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.242285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-03862e6f-c133-42c9-9760-f577cce2a876 None None] MFA Rules not processed for user `04fd3ce020bb41dba50e9c4a2902b1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:29.246122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-03862e6f-c133-42c9-9760-f577cce2a876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:29.412674 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 828/1646] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:29.417665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a06e-e7b6-4fba-a251-3a161845f6f1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:29.534198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a06e-e7b6-4fba-a251-3a161845f6f1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:29.539569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f093ba4-cb83-462f-901d-3322632c36b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:29.539946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f093ba4-cb83-462f-901d-3322632c36b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.540223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f093ba4-cb83-462f-901d-3322632c36b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.540490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f093ba4-cb83-462f-901d-3322632c36b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.541174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f093ba4-cb83-462f-901d-3322632c36b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:29.543557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f093ba4-cb83-462f-901d-3322632c36b1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.581679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 819/1647] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:29 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:29.585537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862e6f-c133-42c9-9760-f577cce2a876 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:29.598980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03862e6f-c133-42c9-9760-f577cce2a876 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:29.665190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:29.685781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e13b1-58ee-4f62-85cc-bc2712d0cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:29.686666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e13b1-58ee-4f62-85cc-bc2712d0cc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.687162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e13b1-58ee-4f62-85cc-bc2712d0cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.687783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e13b1-58ee-4f62-85cc-bc2712d0cc9f admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.688734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e13b1-58ee-4f62-85cc-bc2712d0cc9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:29.692878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e13b1-58ee-4f62-85cc-bc2712d0cc9f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.742215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 829/1648] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:29 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:29.747132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f093ba4-cb83-462f-901d-3322632c36b1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:29.758537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f093ba4-cb83-462f-901d-3322632c36b1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:29.765062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7e18a-30c1-476a-8479-2e66533bc1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:29.766087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e18a-30c1-476a-8479-2e66533bc1ad admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.766512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e18a-30c1-476a-8479-2e66533bc1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.766923 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e18a-30c1-476a-8479-2e66533bc1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.768338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7e18a-30c1-476a-8479-2e66533bc1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:29.770130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7e18a-30c1-476a-8479-2e66533bc1ad admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.783945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 820/1649] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:29.788535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e13b1-58ee-4f62-85cc-bc2712d0cc9f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:29.812644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e13b1-58ee-4f62-85cc-bc2712d0cc9f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:29.817433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06426ef0-1608-4598-a5da-4e3e2403b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:29.818346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426ef0-1608-4598-a5da-4e3e2403b3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.818524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426ef0-1608-4598-a5da-4e3e2403b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.818801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426ef0-1608-4598-a5da-4e3e2403b3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.819501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06426ef0-1608-4598-a5da-4e3e2403b3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:29.821274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06426ef0-1608-4598-a5da-4e3e2403b3fb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.840801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 830/1650] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:29.844767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7e18a-30c1-476a-8479-2e66533bc1ad admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:29.859933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7e18a-30c1-476a-8479-2e66533bc1ad admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:29.865942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:29.866952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.867660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.868094 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] PATH_INFO: `/v3/projects/11cbbfdbc558448fb0b6d4f211499a8e/users/92de5bcc5d7e4beeb45e88da47f54564/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:29.872524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:29.893955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11cbbfdbc558448fb0b6d4f211499a8e, user_id=92de5bcc5d7e4beeb45e88da47f54564, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:29.898359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:29.919289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 821/1651] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:29 2022] PUT /identity/v3/projects/11cbbfdbc558448fb0b6d4f211499a8e/users/92de5bcc5d7e4beeb45e88da47f54564/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:29.932912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efd27e-b014-4667-afb0-0a3b2b0d5bd2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:29.933186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efd27e-b014-4667-afb0-0a3b2b0d5bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:29.933461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efd27e-b014-4667-afb0-0a3b2b0d5bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.012619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-52efd27e-b014-4667-afb0-0a3b2b0d5bd2 None None] MFA Rules not processed for user `92de5bcc5d7e4beeb45e88da47f54564`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:30.013905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-52efd27e-b014-4667-afb0-0a3b2b0d5bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:30.070825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:30.073251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:30.155907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 831/1652] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:30.160596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efd27e-b014-4667-afb0-0a3b2b0d5bd2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:30.203555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc29c6-4ceb-43b1-b069-4bec82345331 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:30.227467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:30.235112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.235442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.235724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] PATH_INFO: `/v3/users/5e1fc907c07448c69de3c11236dfc8c9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.237461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1fc907c07448c69de3c11236dfc8c9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:30.243916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:30.314759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efd27e-b014-4667-afb0-0a3b2b0d5bd2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:30.320457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:30.321225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.321859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.321978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.323708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:30.329943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:30.345425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1fc907c07448c69de3c11236dfc8c9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:30.363731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1fc907c07448c69de3c11236dfc8c9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:30.364988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1fc907c07448c69de3c11236dfc8c9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:30.378724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1fc907c07448c69de3c11236dfc8c9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:30.379490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e5f7e1a4-6f0b-4034-aeea-bdd8213eda23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1fc907c07448c69de3c11236dfc8c9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:30.393211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 832/1653] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:30 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:30.393211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:30.396371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:30.406381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 822/1654] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:30 2022] DELETE /identity/v3/users/5e1fc907c07448c69de3c11236dfc8c9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:30.410937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851880-12d3-407f-a0b4-0d41f1ec55e5 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.411225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851880-12d3-407f-a0b4-0d41f1ec55e5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.411500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851880-12d3-407f-a0b4-0d41f1ec55e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.445203 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-15851880-12d3-407f-a0b4-0d41f1ec55e5 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:30.446934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-15851880-12d3-407f-a0b4-0d41f1ec55e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:30.471524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:30.492713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2a2d7-d426-45ac-972a-555190954cc4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:30.520688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 823/1655] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:30.531342 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15851880-12d3-407f-a0b4-0d41f1ec55e5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:30.532838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-15851880-12d3-407f-a0b4-0d41f1ec55e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:30.538920 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:30.571850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2c4f2-3c8c-4f04-a2a2-ba0c71e841c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:30.572566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c4f2-3c8c-4f04-a2a2-ba0c71e841c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.572962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c4f2-3c8c-4f04-a2a2-ba0c71e841c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.573267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2c4f2-3c8c-4f04-a2a2-ba0c71e841c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.573959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c4f2-3c8c-4f04-a2a2-ba0c71e841c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:30.576408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2c4f2-3c8c-4f04-a2a2-ba0c71e841c2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:30.605701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 833/1656] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:30 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:30.609862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2c4f2-3c8c-4f04-a2a2-ba0c71e841c2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:30.616194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15851880-12d3-407f-a0b4-0d41f1ec55e5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:30.620413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2c4f2-3c8c-4f04-a2a2-ba0c71e841c2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:30.621181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58f86f-7990-4923-b1a4-b9520bc16309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:30.622088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58f86f-7990-4923-b1a4-b9520bc16309 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.622747 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58f86f-7990-4923-b1a4-b9520bc16309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.623157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58f86f-7990-4923-b1a4-b9520bc16309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.625914 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db521eb-f8f7-45f9-bd03-20118ea6b4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:30.626614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db521eb-f8f7-45f9-bd03-20118ea6b4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.626964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db521eb-f8f7-45f9-bd03-20118ea6b4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.627356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db521eb-f8f7-45f9-bd03-20118ea6b4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.628030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db521eb-f8f7-45f9-bd03-20118ea6b4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:30.629791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db521eb-f8f7-45f9-bd03-20118ea6b4d4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:30.637386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58f86f-7990-4923-b1a4-b9520bc16309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:30.639431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58f86f-7990-4923-b1a4-b9520bc16309 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:30.651362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 834/1658] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:30.651545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 824/1658] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:30.655883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58f86f-7990-4923-b1a4-b9520bc16309 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:30.667225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58f86f-7990-4923-b1a4-b9520bc16309 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:30.673274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028246-32b7-4fab-92b2-f283529e484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:30.673988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028246-32b7-4fab-92b2-f283529e484b admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.675027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028246-32b7-4fab-92b2-f283529e484b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.675027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028246-32b7-4fab-92b2-f283529e484b admin admin] PATH_INFO: `/v3/projects/fd0b39ff3a2a4b83ae4c294cf20b2b08/users/a0a2f1fc422e49f198a0ad9f90212fa1/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.693432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0028246-32b7-4fab-92b2-f283529e484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0b39ff3a2a4b83ae4c294cf20b2b08, user_id=a0a2f1fc422e49f198a0ad9f90212fa1, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:30.696849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0028246-32b7-4fab-92b2-f283529e484b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:30.713576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 825/1659] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:30 2022] PUT /identity/v3/projects/fd0b39ff3a2a4b83ae4c294cf20b2b08/users/a0a2f1fc422e49f198a0ad9f90212fa1/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:30.719036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db521eb-f8f7-45f9-bd03-20118ea6b4d4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:30.732673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db521eb-f8f7-45f9-bd03-20118ea6b4d4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:30.849442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab317f-d368-46ca-83c1-91fbd023dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:30.850201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab317f-d368-46ca-83c1-91fbd023dc02 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.850550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab317f-d368-46ca-83c1-91fbd023dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.850909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab317f-d368-46ca-83c1-91fbd023dc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.851642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab317f-d368-46ca-83c1-91fbd023dc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:30.853363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab317f-d368-46ca-83c1-91fbd023dc02 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:30.871643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 835/1660] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:30.873459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028246-32b7-4fab-92b2-f283529e484b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:30.887153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028246-32b7-4fab-92b2-f283529e484b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:30.893004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:30.894583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.894897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.895201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] PATH_INFO: `/v3/projects/fd0b39ff3a2a4b83ae4c294cf20b2b08/users/a0a2f1fc422e49f198a0ad9f90212fa1/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.897272 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0b39ff3a2a4b83ae4c294cf20b2b08, user_id=a0a2f1fc422e49f198a0ad9f90212fa1, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:30.901952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:30.917781 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 826/1661] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:30 2022] PUT /identity/v3/projects/fd0b39ff3a2a4b83ae4c294cf20b2b08/users/a0a2f1fc422e49f198a0ad9f90212fa1/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:30.928258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2401-40ec-4d70-9b08-9bcb6f8355ed None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:30.928642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2401-40ec-4d70-9b08-9bcb6f8355ed None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:30.928862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2401-40ec-4d70-9b08-9bcb6f8355ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:30.974245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8afa2401-40ec-4d70-9b08-9bcb6f8355ed None None] MFA Rules not processed for user `a0a2f1fc422e49f198a0ad9f90212fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:30.988417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8afa2401-40ec-4d70-9b08-9bcb6f8355ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.061165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.063012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.085892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:31.125284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 836/1662] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:31.126307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2401-40ec-4d70-9b08-9bcb6f8355ed None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.130152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8afa2401-40ec-4d70-9b08-9bcb6f8355ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.180686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48a606-13a7-4cca-bad8-c20dcdb64725 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.186020 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.187201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.187489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.187816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] PATH_INFO: `/v3/projects/010f41f3f7dc4226a26085b43500ca26` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.189706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=010f41f3f7dc4226a26085b43500ca26)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.193766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.211745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2401-40ec-4d70-9b08-9bcb6f8355ed None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.217042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827796be-9bef-4338-8044-4ab809ca310c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.218418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827796be-9bef-4338-8044-4ab809ca310c service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.218800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827796be-9bef-4338-8044-4ab809ca310c service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.219290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827796be-9bef-4338-8044-4ab809ca310c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.221257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-827796be-9bef-4338-8044-4ab809ca310c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.264319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010f41f3f7dc4226a26085b43500ca26', 'request_id': 'req-cb2dae60-e45e-458d-9b29-aca6f56a7d48'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.271187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010f41f3f7dc4226a26085b43500ca26', 'request_id': 'req-cb2dae60-e45e-458d-9b29-aca6f56a7d48'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.278848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010f41f3f7dc4226a26085b43500ca26', 'request_id': 'req-cb2dae60-e45e-458d-9b29-aca6f56a7d48'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.289745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:31.295101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] The token cache is being invalidate because project 010f41f3f7dc4226a26085b43500ca26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:31.296098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.296638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cb2dae60-e45e-458d-9b29-aca6f56a7d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.298767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 827/1663] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:31 2022] DELETE /identity/v3/projects/010f41f3f7dc4226a26085b43500ca26 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:31.299396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827796be-9bef-4338-8044-4ab809ca310c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.300856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827796be-9bef-4338-8044-4ab809ca310c service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.303543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bbd33-4cc7-41ae-9bc3-6c10e484b93c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.303978 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bbd33-4cc7-41ae-9bc3-6c10e484b93c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.304503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bbd33-4cc7-41ae-9bc3-6c10e484b93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.311590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 837/1664] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:31.326414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-e41bbd33-4cc7-41ae-9bc3-6c10e484b93c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:31.327927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e41bbd33-4cc7-41ae-9bc3-6c10e484b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.395417 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 828/1665] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:31.404927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe71c-86aa-4b45-85eb-a4e719b1f6f9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.405265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe71c-86aa-4b45-85eb-a4e719b1f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.405584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe71c-86aa-4b45-85eb-a4e719b1f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.428747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-301fe71c-86aa-4b45-85eb-a4e719b1f6f9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:31.429987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-301fe71c-86aa-4b45-85eb-a4e719b1f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.446402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 838/1666] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:31.448848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bbd33-4cc7-41ae-9bc3-6c10e484b93c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.462169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bbd33-4cc7-41ae-9bc3-6c10e484b93c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.474473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.475309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.475629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.475995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.476752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:31.477155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.479573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.497877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 829/1667] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:31.499068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fe71c-86aa-4b45-85eb-a4e719b1f6f9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.516313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fe71c-86aa-4b45-85eb-a4e719b1f6f9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.527811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1f07-72c2-4f07-8d14-4a54cdec209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.529607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1f07-72c2-4f07-8d14-4a54cdec209e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.530031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1f07-72c2-4f07-8d14-4a54cdec209e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.532170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1f07-72c2-4f07-8d14-4a54cdec209e admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.533953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a1f07-72c2-4f07-8d14-4a54cdec209e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.537256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a1f07-72c2-4f07-8d14-4a54cdec209e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.581199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 839/1668] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:31 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:31.583219 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.604262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551143a4-7702-430b-b279-7f9ef66a039c admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.735286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.736001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.736182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.736453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.737101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.741626 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.776675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 830/1669] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:31 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:31.777830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1f07-72c2-4f07-8d14-4a54cdec209e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.790891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.793602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.811836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1f07-72c2-4f07-8d14-4a54cdec209e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.817005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d3633-acde-4dc3-af6e-81d527ec3366 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.820377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb84f-a2ac-4b5f-8203-d1f4c65fbb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.821013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb84f-a2ac-4b5f-8203-d1f4c65fbb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.821294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb84f-a2ac-4b5f-8203-d1f4c65fbb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.822077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fb84f-a2ac-4b5f-8203-d1f4c65fbb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.822655 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.822780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fb84f-a2ac-4b5f-8203-d1f4c65fbb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.823676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.823854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.824254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] PATH_INFO: `/v3/users/dfafaac7050f47e69c31e99d930ab1ea` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.824833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fb84f-a2ac-4b5f-8203-d1f4c65fbb51 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.825929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfafaac7050f47e69c31e99d930ab1ea)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.828727 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.841250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 840/1670] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:31.845695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb84f-a2ac-4b5f-8203-d1f4c65fbb51 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.860184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fb84f-a2ac-4b5f-8203-d1f4c65fbb51 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.870342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea07d5-964f-4fab-b3ef-d1fd5648146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.871340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea07d5-964f-4fab-b3ef-d1fd5648146e admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.871866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea07d5-964f-4fab-b3ef-d1fd5648146e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.872121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea07d5-964f-4fab-b3ef-d1fd5648146e admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.872856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea07d5-964f-4fab-b3ef-d1fd5648146e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.875363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea07d5-964f-4fab-b3ef-d1fd5648146e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.888281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 841/1671] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:31.893117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea07d5-964f-4fab-b3ef-d1fd5648146e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.906574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea07d5-964f-4fab-b3ef-d1fd5648146e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:31.906768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfafaac7050f47e69c31e99d930ab1ea'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.911407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:31.912187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.912478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.912856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] PATH_INFO: `/v3/projects/339947ece80d41259a0486bb5d9ef01f/users/f14a3a7cd7444250ad9d27f7727de19d/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.921835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfafaac7050f47e69c31e99d930ab1ea'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.922617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfafaac7050f47e69c31e99d930ab1ea'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.926899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:31.931409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] RBAC: Authorizing `identity:create_grant(project_id=339947ece80d41259a0486bb5d9ef01f, user_id=f14a3a7cd7444250ad9d27f7727de19d, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:31.934065 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfafaac7050f47e69c31e99d930ab1ea'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.934348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:31.935167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-70a70841-52f2-468c-854b-53e47019971d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfafaac7050f47e69c31e99d930ab1ea'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:31.949455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 842/1672] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:31 2022] PUT /identity/v3/projects/339947ece80d41259a0486bb5d9ef01f/users/f14a3a7cd7444250ad9d27f7727de19d/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:31.950557 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:31.951878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 831/1673] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:31 2022] DELETE /identity/v3/users/dfafaac7050f47e69c31e99d930ab1ea => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:31.955030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.956356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961cd6-2fcf-463d-97f8-8ca6accd35b2 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:31.956922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961cd6-2fcf-463d-97f8-8ca6accd35b2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:31.957412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961cd6-2fcf-463d-97f8-8ca6accd35b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:31.992037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-19961cd6-2fcf-463d-97f8-8ca6accd35b2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:31.994079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-19961cd6-2fcf-463d-97f8-8ca6accd35b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:31.996386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:32.029890 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27802c1e-07fe-449e-a6cd-e8cb64d5696c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:32.065664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 832/1674] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:32.067443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6688-c534-45a1-912a-6015bb54431c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:32.067833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6688-c534-45a1-912a-6015bb54431c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:32.068264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6688-c534-45a1-912a-6015bb54431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:32.100808 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5b1c6688-c534-45a1-912a-6015bb54431c None None] MFA Rules not processed for user `f14a3a7cd7444250ad9d27f7727de19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:32.101413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:32.102099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:32.102395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5b1c6688-c534-45a1-912a-6015bb54431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:32.102505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:32.102709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] PATH_INFO: `/v3/users/9b5cfcf7d1ca4b6f85309e8c97c2302c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:32.103955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5cfcf7d1ca4b6f85309e8c97c2302c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:32.105952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:32.180744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 833/1675] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:32.182286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c6688-c534-45a1-912a-6015bb54431c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:32.182586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5cfcf7d1ca4b6f85309e8c97c2302c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:32.183818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5b1c6688-c534-45a1-912a-6015bb54431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:32.199284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5cfcf7d1ca4b6f85309e8c97c2302c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:32.200186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5cfcf7d1ca4b6f85309e8c97c2302c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:32.209675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5cfcf7d1ca4b6f85309e8c97c2302c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:32.210593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5cfcf7d1ca4b6f85309e8c97c2302c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:32.228218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 843/1676] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:31 2022] DELETE /identity/v3/users/9b5cfcf7d1ca4b6f85309e8c97c2302c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:32.232530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:32.234521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:32.251055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c6688-c534-45a1-912a-6015bb54431c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:32.305889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:32.320004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d771-f3e9-4d4c-99d4-4764c45c6273 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:32.330447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:32.331078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:32.331358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:32.331685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:32.335648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f55f2-89f1-43be-9f4a-8f25e92c663b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:32.336275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f55f2-89f1-43be-9f4a-8f25e92c663b service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:32.336549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f55f2-89f1-43be-9f4a-8f25e92c663b service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:32.336817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f55f2-89f1-43be-9f4a-8f25e92c663b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:32.338447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:32.338694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f82f55f2-89f1-43be-9f4a-8f25e92c663b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:32.366959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:32.428612 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f55f2-89f1-43be-9f4a-8f25e92c663b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:32.429355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:32.430631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f55f2-89f1-43be-9f4a-8f25e92c663b service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:32.431152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:32.441747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 844/1677] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:32.442964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 834/1678] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:32.443726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34308b6c-14e8-44b4-938b-439b9afa4146 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:32.444149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34308b6c-14e8-44b4-938b-439b9afa4146 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:32.444417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34308b6c-14e8-44b4-938b-439b9afa4146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:32.468678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-34308b6c-14e8-44b4-938b-439b9afa4146 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:32.471638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-34308b6c-14e8-44b4-938b-439b9afa4146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:32.495638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 845/1679] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:32.509208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:32.513011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:32.530461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3aff6-fc2f-4d3d-8ada-174a77ed5899 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:32.535619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803aa49-f06e-44dd-828b-7aa7f3291903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:32.536358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803aa49-f06e-44dd-828b-7aa7f3291903 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:32.536640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803aa49-f06e-44dd-828b-7aa7f3291903 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:32.536917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803aa49-f06e-44dd-828b-7aa7f3291903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:32.549262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803aa49-f06e-44dd-828b-7aa7f3291903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:32.550853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803aa49-f06e-44dd-828b-7aa7f3291903 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:32.562661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 835/1680] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:32.837374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34308b6c-14e8-44b4-938b-439b9afa4146 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:32.840028 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-34308b6c-14e8-44b4-938b-439b9afa4146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:32.872040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34308b6c-14e8-44b4-938b-439b9afa4146 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:32.892248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:32.894123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:32.894123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:32.894123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] PATH_INFO: `/v3/projects/d7320ab20e664d04bdae9cee83fa6f5d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:32.900003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7320ab20e664d04bdae9cee83fa6f5d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:32.904198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:33.010350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7320ab20e664d04bdae9cee83fa6f5d', 'request_id': 'req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.017497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7320ab20e664d04bdae9cee83fa6f5d', 'request_id': 'req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.025014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7320ab20e664d04bdae9cee83fa6f5d', 'request_id': 'req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.051139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] The token cache is being invalidate because project d7320ab20e664d04bdae9cee83fa6f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:33.051504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.053191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.059294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 846/1681] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:32 2022] DELETE /identity/v3/projects/d7320ab20e664d04bdae9cee83fa6f5d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:33.059463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803aa49-f06e-44dd-828b-7aa7f3291903 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:33.072877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803aa49-f06e-44dd-828b-7aa7f3291903 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:33.117946 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:33.119500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:33.189180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:33.189981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:33.190361 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:33.190790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] PATH_INFO: `/v3/users/ec65655006c349e2b8e44c7c195be8dc` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:33.192520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec65655006c349e2b8e44c7c195be8dc)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:33.194683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:33.233743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b864f-a4b3-4e20-8b0a-87336b3f6bca admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:33.253869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:33.254450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:33.255342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:33.255632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] PATH_INFO: `/v3/projects/72e7456fac514a2b923c54d64f91ee17` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:33.256210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec65655006c349e2b8e44c7c195be8dc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.257025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e7456fac514a2b923c54d64f91ee17)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:33.271008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:33.272875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec65655006c349e2b8e44c7c195be8dc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.273906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec65655006c349e2b8e44c7c195be8dc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.285895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec65655006c349e2b8e44c7c195be8dc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.286657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec65655006c349e2b8e44c7c195be8dc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.288449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:33.305825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 836/1682] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:33 2022] DELETE /identity/v3/users/ec65655006c349e2b8e44c7c195be8dc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:33.309547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:33.311621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:33.349021 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:33.371506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e7456fac514a2b923c54d64f91ee17', 'request_id': 'req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.378759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e7456fac514a2b923c54d64f91ee17', 'request_id': 'req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.390499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e7456fac514a2b923c54d64f91ee17', 'request_id': 'req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.398783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f52cbc-472f-4fea-9dc5-670d4e0b4904 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:33.426160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] The token cache is being invalidate because project 72e7456fac514a2b923c54d64f91ee17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:33.426511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.427328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.434234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 847/1683] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:33 2022] DELETE /identity/v3/projects/72e7456fac514a2b923c54d64f91ee17 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:33.436140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:33.438565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:33.513319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:33.513980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:33.514256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:33.514532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:33.519745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:33.546903 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e9ce-d7ee-458e-b8f2-255c148fbb33 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:33.563571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:33.564452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:33.564833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:33.565199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] PATH_INFO: `/v3/users/8497d2b776494759848caecc6b03f787` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:33.568769 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8497d2b776494759848caecc6b03f787)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:33.571452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:33.623450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:33.626311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:33.638760 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 837/1684] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:33.673686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8497d2b776494759848caecc6b03f787'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.701430 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8497d2b776494759848caecc6b03f787'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.703293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8497d2b776494759848caecc6b03f787'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.714349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8497d2b776494759848caecc6b03f787'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.715189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8497d2b776494759848caecc6b03f787'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:33.739152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 848/1685] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:33 2022] DELETE /identity/v3/users/8497d2b776494759848caecc6b03f787 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:33.936837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:33.938785 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:33.972452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ee618-3071-4ffb-bb15-968d4b8e4f56 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.127128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.127761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.128609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.128609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] PATH_INFO: `/v3/projects/d913ed9382114c0493ed36075b522ff0` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.129616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d913ed9382114c0493ed36075b522ff0)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.139315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.142073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:34.210690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.217461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:34.239946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd913ed9382114c0493ed36075b522ff0', 'request_id': 'req-a1d4814c-b692-4f2d-8660-9394cfab9d76'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.245746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd913ed9382114c0493ed36075b522ff0', 'request_id': 'req-a1d4814c-b692-4f2d-8660-9394cfab9d76'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.252895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd913ed9382114c0493ed36075b522ff0', 'request_id': 'req-a1d4814c-b692-4f2d-8660-9394cfab9d76'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.264368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6c163-e492-46a2-9211-390bf4950125 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.270352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] The token cache is being invalidate because project d913ed9382114c0493ed36075b522ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:34.271665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.274050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a1d4814c-b692-4f2d-8660-9394cfab9d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.276868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 838/1686] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:33 2022] DELETE /identity/v3/projects/d913ed9382114c0493ed36075b522ff0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:34.281703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53a21-a1f4-4b11-ba11-3ff302419fa4 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.281983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53a21-a1f4-4b11-ba11-3ff302419fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.282464 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e53a21-a1f4-4b11-ba11-3ff302419fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.338582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-73e53a21-a1f4-4b11-ba11-3ff302419fa4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:34.339800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-73e53a21-a1f4-4b11-ba11-3ff302419fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:34.389126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:34.426463 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.428008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.428462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.428926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] PATH_INFO: `/v3/projects/94db14b5828341748bdb72ef3a932470` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.431267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94db14b5828341748bdb72ef3a932470)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.434072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.472671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 839/1687] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:34.476087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e19765-4e00-4448-86cd-b20be37244ef None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.476979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e19765-4e00-4448-86cd-b20be37244ef None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.477267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e19765-4e00-4448-86cd-b20be37244ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.500362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-34e19765-4e00-4448-86cd-b20be37244ef None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:34.501671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-34e19765-4e00-4448-86cd-b20be37244ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:34.510717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94db14b5828341748bdb72ef3a932470', 'request_id': 'req-86609c60-5b2d-43a5-90c8-0edbe560ac12'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.522924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94db14b5828341748bdb72ef3a932470', 'request_id': 'req-86609c60-5b2d-43a5-90c8-0edbe560ac12'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.534838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94db14b5828341748bdb72ef3a932470', 'request_id': 'req-86609c60-5b2d-43a5-90c8-0edbe560ac12'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.550919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] The token cache is being invalidate because project 94db14b5828341748bdb72ef3a932470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:34.551405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.552183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-86609c60-5b2d-43a5-90c8-0edbe560ac12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:34.554362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 849/1688] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:34 2022] DELETE /identity/v3/projects/94db14b5828341748bdb72ef3a932470 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:34.559244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ea73b-c463-4e04-a6ee-5e9355aff385 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.559574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ea73b-c463-4e04-a6ee-5e9355aff385 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.560062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ea73b-c463-4e04-a6ee-5e9355aff385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.571775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 840/1689] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:34.586013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e19765-4e00-4448-86cd-b20be37244ef None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.603217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ce5ea73b-c463-4e04-a6ee-5e9355aff385 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:34.604503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ce5ea73b-c463-4e04-a6ee-5e9355aff385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:34.611465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e19765-4e00-4448-86cd-b20be37244ef None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.618365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.619342 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.619555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.619887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.620548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:34.620853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.622491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.626240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 850/1690] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:34.635405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adec1-c752-4caa-a68a-7dceebbe659e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.635876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adec1-c752-4caa-a68a-7dceebbe659e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.636326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6adec1-c752-4caa-a68a-7dceebbe659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.640609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 841/1691] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:34.641734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.655040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05527b2-b113-40b9-b2f9-f53af8d92fbd admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.661491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45300b-7406-4215-993d-4c057fadda6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.662109 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45300b-7406-4215-993d-4c057fadda6c admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.662387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45300b-7406-4215-993d-4c057fadda6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.662650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45300b-7406-4215-993d-4c057fadda6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.663632 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45300b-7406-4215-993d-4c057fadda6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.665846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45300b-7406-4215-993d-4c057fadda6c admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.699338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:34.700618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7e6adec1-c752-4caa-a68a-7dceebbe659e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:34.702579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7e6adec1-c752-4caa-a68a-7dceebbe659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:34.702718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 842/1692] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:34 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:34.722839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45300b-7406-4215-993d-4c057fadda6c admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.773999 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 851/1693] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:34.774842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6adec1-c752-4caa-a68a-7dceebbe659e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.776707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7e6adec1-c752-4caa-a68a-7dceebbe659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:34.791477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45300b-7406-4215-993d-4c057fadda6c admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.796700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4529e7-1b77-4541-87af-2c8c6fe05a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.797360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4529e7-1b77-4541-87af-2c8c6fe05a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.797784 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4529e7-1b77-4541-87af-2c8c6fe05a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.797947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4529e7-1b77-4541-87af-2c8c6fe05a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.798586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4529e7-1b77-4541-87af-2c8c6fe05a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.800501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4529e7-1b77-4541-87af-2c8c6fe05a19 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.832035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 843/1694] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:34 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:34.833145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4529e7-1b77-4541-87af-2c8c6fe05a19 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.843828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4529e7-1b77-4541-87af-2c8c6fe05a19 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.846462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6adec1-c752-4caa-a68a-7dceebbe659e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.848851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.849475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.849775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.850056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.850746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:34.851052 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.852061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.852678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.853062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.853597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.854037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.855964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:34.865989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 844/1695] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:34.866837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.877155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba729daa-00fb-4514-825b-788455094317 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.881728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:34.882049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201cc5-8658-4954-8e4f-f078a9b2b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.882877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201cc5-8658-4954-8e4f-f078a9b2b2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.883042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201cc5-8658-4954-8e4f-f078a9b2b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.883376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201cc5-8658-4954-8e4f-f078a9b2b2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.883975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a201cc5-8658-4954-8e4f-f078a9b2b2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.886183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a201cc5-8658-4954-8e4f-f078a9b2b2a8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.902407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 845/1696] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:34.903307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201cc5-8658-4954-8e4f-f078a9b2b2a8 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.918145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201cc5-8658-4954-8e4f-f078a9b2b2a8 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:34.924346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef28cf-f9ca-4bab-846c-4709b21ccf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:34.924950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef28cf-f9ca-4bab-846c-4709b21ccf8b admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:34.925228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef28cf-f9ca-4bab-846c-4709b21ccf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:34.925526 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef28cf-f9ca-4bab-846c-4709b21ccf8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:34.926167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef28cf-f9ca-4bab-846c-4709b21ccf8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.928268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef28cf-f9ca-4bab-846c-4709b21ccf8b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.962264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 846/1697] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:34 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:34.963972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef28cf-f9ca-4bab-846c-4709b21ccf8b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:34.969466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:34.971489 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:34.985407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 852/1698] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:35.005688 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.026641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fd59c-85a2-4877-89b0-75a363126f89 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.107592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef28cf-f9ca-4bab-846c-4709b21ccf8b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.119663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e31597-dff7-4828-9750-2b7417aedbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.120365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31597-dff7-4828-9750-2b7417aedbed admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.120603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31597-dff7-4828-9750-2b7417aedbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.120875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e31597-dff7-4828-9750-2b7417aedbed admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.122999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e31597-dff7-4828-9750-2b7417aedbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.123525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e31597-dff7-4828-9750-2b7417aedbed admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.133823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c294-364f-475e-8926-fbc1959671d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.134922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c294-364f-475e-8926-fbc1959671d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.135584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c294-364f-475e-8926-fbc1959671d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.137744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c294-364f-475e-8926-fbc1959671d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.138701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c294-364f-475e-8926-fbc1959671d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.142722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c294-364f-475e-8926-fbc1959671d0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.146474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 847/1699] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:35.151351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e31597-dff7-4828-9750-2b7417aedbed admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.165074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e31597-dff7-4828-9750-2b7417aedbed admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.170909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38cdc5-a9b8-4024-9199-a495028af40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.171786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38cdc5-a9b8-4024-9199-a495028af40d admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.171896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38cdc5-a9b8-4024-9199-a495028af40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.172146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38cdc5-a9b8-4024-9199-a495028af40d admin admin] PATH_INFO: `/v3/projects/5100034280f14d728d09d4a971c7096c/users/ef1b02a983d64b8983bc1f8f59c7ece9/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.183915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 853/1700] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:34 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:35.187680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c294-364f-475e-8926-fbc1959671d0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.196789 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38cdc5-a9b8-4024-9199-a495028af40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5100034280f14d728d09d4a971c7096c, user_id=ef1b02a983d64b8983bc1f8f59c7ece9, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.200110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38cdc5-a9b8-4024-9199-a495028af40d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.200485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c294-364f-475e-8926-fbc1959671d0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.207791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50b45c-6eaf-472e-8e5c-5dc64b5fef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.208523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50b45c-6eaf-472e-8e5c-5dc64b5fef80 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.208762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50b45c-6eaf-472e-8e5c-5dc64b5fef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.209136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50b45c-6eaf-472e-8e5c-5dc64b5fef80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.210131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50b45c-6eaf-472e-8e5c-5dc64b5fef80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.211707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50b45c-6eaf-472e-8e5c-5dc64b5fef80 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.216827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 848/1701] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:35 2022] PUT /identity/v3/projects/5100034280f14d728d09d4a971c7096c/users/ef1b02a983d64b8983bc1f8f59c7ece9/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:35.223235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 854/1702] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:35.230494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38cdc5-a9b8-4024-9199-a495028af40d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.231568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc3421-b013-491b-8cf4-9a5e883d7d78 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.231990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc3421-b013-491b-8cf4-9a5e883d7d78 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.232311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc3421-b013-491b-8cf4-9a5e883d7d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.245687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:35.269195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-01bc3421-b013-491b-8cf4-9a5e883d7d78 None None] MFA Rules not processed for user `ef1b02a983d64b8983bc1f8f59c7ece9`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:35.270550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-01bc3421-b013-491b-8cf4-9a5e883d7d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:35.310092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38cdc5-a9b8-4024-9199-a495028af40d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.315518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ec3e-a736-4e0b-a6a4-22e50601a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.316163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ec3e-a736-4e0b-a6a4-22e50601a093 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.316889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ec3e-a736-4e0b-a6a4-22e50601a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.316889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ec3e-a736-4e0b-a6a4-22e50601a093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.317411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3ec3e-a736-4e0b-a6a4-22e50601a093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.319228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3ec3e-a736-4e0b-a6a4-22e50601a093 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.334702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 849/1703] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:35.335941 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ec3e-a736-4e0b-a6a4-22e50601a093 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.353096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ec3e-a736-4e0b-a6a4-22e50601a093 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.356218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 855/1704] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:35.358657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcedcd1-65bc-4b20-8aca-8270e0410704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.359664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedcd1-65bc-4b20-8aca-8270e0410704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.360006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedcd1-65bc-4b20-8aca-8270e0410704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.360348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedcd1-65bc-4b20-8aca-8270e0410704 admin admin] PATH_INFO: `/v3/projects/60763b60510343e1805e2825f6959eb1/users/f0ec5a7fdd3047468bdee3020f42646b/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.369258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc3421-b013-491b-8cf4-9a5e883d7d78 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.378162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcedcd1-65bc-4b20-8aca-8270e0410704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60763b60510343e1805e2825f6959eb1, user_id=f0ec5a7fdd3047468bdee3020f42646b, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.380966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcedcd1-65bc-4b20-8aca-8270e0410704 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.381590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc3421-b013-491b-8cf4-9a5e883d7d78 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.387706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a459f-9cd0-415c-ba43-e9d5b31ee9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.388553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a459f-9cd0-415c-ba43-e9d5b31ee9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.388900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a459f-9cd0-415c-ba43-e9d5b31ee9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.389179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a459f-9cd0-415c-ba43-e9d5b31ee9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.389945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a459f-9cd0-415c-ba43-e9d5b31ee9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.391866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a459f-9cd0-415c-ba43-e9d5b31ee9f4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.396011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 850/1705] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:35 2022] PUT /identity/v3/projects/60763b60510343e1805e2825f6959eb1/users/f0ec5a7fdd3047468bdee3020f42646b/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:35.407803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee6ff-d584-4d00-8bfc-e8cb2189085a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.408175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee6ff-d584-4d00-8bfc-e8cb2189085a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.408440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee6ff-d584-4d00-8bfc-e8cb2189085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.415396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:35.423323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 856/1706] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:35.427305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a459f-9cd0-415c-ba43-e9d5b31ee9f4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.438334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-68eee6ff-d584-4d00-8bfc-e8cb2189085a None None] MFA Rules not processed for user `f0ec5a7fdd3047468bdee3020f42646b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:35.439527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-68eee6ff-d584-4d00-8bfc-e8cb2189085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:35.490311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a459f-9cd0-415c-ba43-e9d5b31ee9f4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.495081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8440d-7731-403c-a676-5ef01a90ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.495691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8440d-7731-403c-a676-5ef01a90ac84 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.495969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8440d-7731-403c-a676-5ef01a90ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.496242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8440d-7731-403c-a676-5ef01a90ac84 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.496874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8440d-7731-403c-a676-5ef01a90ac84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.498847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8440d-7731-403c-a676-5ef01a90ac84 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.502502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 851/1707] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:35.507468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eee6ff-d584-4d00-8bfc-e8cb2189085a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.519616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eee6ff-d584-4d00-8bfc-e8cb2189085a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.520261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 857/1708] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:00:35.524095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8440d-7731-403c-a676-5ef01a90ac84 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.525955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353cc14-c808-43fd-9b5b-d8d4114f28da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.526591 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353cc14-c808-43fd-9b5b-d8d4114f28da admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.526877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353cc14-c808-43fd-9b5b-d8d4114f28da admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.527261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353cc14-c808-43fd-9b5b-d8d4114f28da admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.527902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353cc14-c808-43fd-9b5b-d8d4114f28da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.529889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353cc14-c808-43fd-9b5b-d8d4114f28da admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.534002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8440d-7731-403c-a676-5ef01a90ac84 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.538792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb15b4-a589-4b63-8ba1-4ffddb0d75eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.539377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb15b4-a589-4b63-8ba1-4ffddb0d75eb admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.540080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb15b4-a589-4b63-8ba1-4ffddb0d75eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.540349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb15b4-a589-4b63-8ba1-4ffddb0d75eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.541548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb15b4-a589-4b63-8ba1-4ffddb0d75eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.543510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb15b4-a589-4b63-8ba1-4ffddb0d75eb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.554260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 858/1709] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:35.560774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 852/1710] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:35.560913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb15b4-a589-4b63-8ba1-4ffddb0d75eb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.562050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353cc14-c808-43fd-9b5b-d8d4114f28da admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.568059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb15b4-a589-4b63-8ba1-4ffddb0d75eb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.613738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:35.623578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e26c32-273f-4848-a1f1-06e021911c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.624185 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26c32-273f-4848-a1f1-06e021911c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.624457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26c32-273f-4848-a1f1-06e021911c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.624724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26c32-273f-4848-a1f1-06e021911c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.625358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e26c32-273f-4848-a1f1-06e021911c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.626946 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353cc14-c808-43fd-9b5b-d8d4114f28da admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.627051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e26c32-273f-4848-a1f1-06e021911c13 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.631774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6abd-7e91-4c72-bc53-6330617ffd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.632441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6abd-7e91-4c72-bc53-6330617ffd99 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.632840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6abd-7e91-4c72-bc53-6330617ffd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.633119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6abd-7e91-4c72-bc53-6330617ffd99 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.633790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf6abd-7e91-4c72-bc53-6330617ffd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.635715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf6abd-7e91-4c72-bc53-6330617ffd99 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.636867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 859/1711] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:35.640848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e26c32-273f-4848-a1f1-06e021911c13 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.651146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e26c32-273f-4848-a1f1-06e021911c13 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.656386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f30cd-69f5-4aa4-8da3-ace244569a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.657034 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f30cd-69f5-4aa4-8da3-ace244569a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.657305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f30cd-69f5-4aa4-8da3-ace244569a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.657607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f30cd-69f5-4aa4-8da3-ace244569a4c admin admin] PATH_INFO: `/v3/projects/464f7e536339467fa1cefb091bb2f13d/users/03f07f1389c04b708004126223f7605d/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.660467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 853/1712] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:00:35.661456 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6abd-7e91-4c72-bc53-6330617ffd99 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.671103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6abd-7e91-4c72-bc53-6330617ffd99 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.672589 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f30cd-69f5-4aa4-8da3-ace244569a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=464f7e536339467fa1cefb091bb2f13d, user_id=03f07f1389c04b708004126223f7605d, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.675372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f30cd-69f5-4aa4-8da3-ace244569a4c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.676019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91290b9a-152f-4413-9e15-c35c5ec654f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.676603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91290b9a-152f-4413-9e15-c35c5ec654f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.676879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91290b9a-152f-4413-9e15-c35c5ec654f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.677147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91290b9a-152f-4413-9e15-c35c5ec654f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.677809 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91290b9a-152f-4413-9e15-c35c5ec654f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.679448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91290b9a-152f-4413-9e15-c35c5ec654f6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.690461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 860/1713] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:35 2022] PUT /identity/v3/projects/464f7e536339467fa1cefb091bb2f13d/users/03f07f1389c04b708004126223f7605d/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:35.698404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 854/1714] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:35.699921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91290b9a-152f-4413-9e15-c35c5ec654f6 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.701341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e593e0-4f5e-40ba-b972-41c85b17243a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.701674 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e593e0-4f5e-40ba-b972-41c85b17243a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.701948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e593e0-4f5e-40ba-b972-41c85b17243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.719894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91290b9a-152f-4413-9e15-c35c5ec654f6 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.734002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e9e593e0-4f5e-40ba-b972-41c85b17243a None None] MFA Rules not processed for user `03f07f1389c04b708004126223f7605d`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:35.735476 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e9e593e0-4f5e-40ba-b972-41c85b17243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:35.778796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:35.784742 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0e8d1-109b-49ee-8a46-a21bcce62d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.785341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0e8d1-109b-49ee-8a46-a21bcce62d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.785665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0e8d1-109b-49ee-8a46-a21bcce62d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.785942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0e8d1-109b-49ee-8a46-a21bcce62d50 admin admin] PATH_INFO: `/v3/projects/52a1e1fbe4774a7081c17bc2ff90dd2e/users/1293a9faa51c4b6b8763842cd7a40b9f/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.800919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0e8d1-109b-49ee-8a46-a21bcce62d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a1e1fbe4774a7081c17bc2ff90dd2e, user_id=1293a9faa51c4b6b8763842cd7a40b9f, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.803624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0e8d1-109b-49ee-8a46-a21bcce62d50 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.807880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 861/1715] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:35.813084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e593e0-4f5e-40ba-b972-41c85b17243a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.823428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e593e0-4f5e-40ba-b972-41c85b17243a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.833531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 855/1716] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:35 2022] PUT /identity/v3/projects/52a1e1fbe4774a7081c17bc2ff90dd2e/users/1293a9faa51c4b6b8763842cd7a40b9f/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:35.837187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0e8d1-109b-49ee-8a46-a21bcce62d50 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.890638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd24b1-545e-4d11-bd07-d9a7c59d1fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.891268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd24b1-545e-4d11-bd07-d9a7c59d1fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.891709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd24b1-545e-4d11-bd07-d9a7c59d1fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.891991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd24b1-545e-4d11-bd07-d9a7c59d1fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.892962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd24b1-545e-4d11-bd07-d9a7c59d1fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.895199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd24b1-545e-4d11-bd07-d9a7c59d1fd7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.903683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0e8d1-109b-49ee-8a46-a21bcce62d50 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:35.908871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32059886-0af7-4506-bf86-b1e83169dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:35.910012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32059886-0af7-4506-bf86-b1e83169dd38 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:35.910012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32059886-0af7-4506-bf86-b1e83169dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:35.910205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32059886-0af7-4506-bf86-b1e83169dd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:35.910842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32059886-0af7-4506-bf86-b1e83169dd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:35.912442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32059886-0af7-4506-bf86-b1e83169dd38 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:35.925659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 856/1717] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:35.928734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32059886-0af7-4506-bf86-b1e83169dd38 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.929090 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 862/1718] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:00:35.932515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd24b1-545e-4d11-bd07-d9a7c59d1fd7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:35.939691 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32059886-0af7-4506-bf86-b1e83169dd38 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.000425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:36.013573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd24b1-545e-4d11-bd07-d9a7c59d1fd7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.018642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dd86a-88d8-4206-a5da-37250a260e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.019345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd86a-88d8-4206-a5da-37250a260e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.019661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd86a-88d8-4206-a5da-37250a260e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.019905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603928-24a7-4fc6-a3e5-2f4e9433e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.020090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd86a-88d8-4206-a5da-37250a260e4d admin admin] PATH_INFO: `/v3/projects/52a1e1fbe4774a7081c17bc2ff90dd2e/users/1293a9faa51c4b6b8763842cd7a40b9f/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.020756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603928-24a7-4fc6-a3e5-2f4e9433e406 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.021053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603928-24a7-4fc6-a3e5-2f4e9433e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.021334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc603928-24a7-4fc6-a3e5-2f4e9433e406 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.021991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc603928-24a7-4fc6-a3e5-2f4e9433e406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.022535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dd86a-88d8-4206-a5da-37250a260e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a1e1fbe4774a7081c17bc2ff90dd2e, user_id=1293a9faa51c4b6b8763842cd7a40b9f, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.023977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc603928-24a7-4fc6-a3e5-2f4e9433e406 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.026171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dd86a-88d8-4206-a5da-37250a260e4d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.038145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 857/1719] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:35 2022] PUT /identity/v3/projects/52a1e1fbe4774a7081c17bc2ff90dd2e/users/1293a9faa51c4b6b8763842cd7a40b9f/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:36.047810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8ffde-ec30-43d9-836e-67f5754e99ba None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.048582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8ffde-ec30-43d9-836e-67f5754e99ba None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.049658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 863/1720] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:35 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:36.049779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8ffde-ec30-43d9-836e-67f5754e99ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.053361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603928-24a7-4fc6-a3e5-2f4e9433e406 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:36.065838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc603928-24a7-4fc6-a3e5-2f4e9433e406 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.145891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-fcd8ffde-ec30-43d9-836e-67f5754e99ba None None] MFA Rules not processed for user `1293a9faa51c4b6b8763842cd7a40b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:36.145891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-fcd8ffde-ec30-43d9-836e-67f5754e99ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:36.175551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:36.186492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fff4f-9cc6-4b62-947b-2977bbc46a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.187448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fff4f-9cc6-4b62-947b-2977bbc46a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.187870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fff4f-9cc6-4b62-947b-2977bbc46a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.188272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fff4f-9cc6-4b62-947b-2977bbc46a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.189593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fff4f-9cc6-4b62-947b-2977bbc46a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.191676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fff4f-9cc6-4b62-947b-2977bbc46a4f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.209508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 864/1721] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:36.210568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fff4f-9cc6-4b62-947b-2977bbc46a4f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:36.223510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fff4f-9cc6-4b62-947b-2977bbc46a4f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.229824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802a56-b35e-4e22-a262-55681b7cee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.230847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802a56-b35e-4e22-a262-55681b7cee88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.231274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802a56-b35e-4e22-a262-55681b7cee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.231769 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f802a56-b35e-4e22-a262-55681b7cee88 admin admin] PATH_INFO: `/v3/projects/4910df3df0404d2cbf86fa2ea839d5f6/users/bad1c6be841940e2b2add4398e0ad1d0/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.252324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f802a56-b35e-4e22-a262-55681b7cee88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4910df3df0404d2cbf86fa2ea839d5f6, user_id=bad1c6be841940e2b2add4398e0ad1d0, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.255469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f802a56-b35e-4e22-a262-55681b7cee88 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.260195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 858/1722] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:36.272805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8ffde-ec30-43d9-836e-67f5754e99ba None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:36.281440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 865/1723] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:36 2022] PUT /identity/v3/projects/4910df3df0404d2cbf86fa2ea839d5f6/users/bad1c6be841940e2b2add4398e0ad1d0/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:36.285431 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802a56-b35e-4e22-a262-55681b7cee88 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:36.332844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8ffde-ec30-43d9-836e-67f5754e99ba None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.358360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f802a56-b35e-4e22-a262-55681b7cee88 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.363510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa75c4-7d63-4829-9a36-46d457f73c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.364120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa75c4-7d63-4829-9a36-46d457f73c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.364390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa75c4-7d63-4829-9a36-46d457f73c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.364656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa75c4-7d63-4829-9a36-46d457f73c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.365428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa75c4-7d63-4829-9a36-46d457f73c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.367275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa75c4-7d63-4829-9a36-46d457f73c7f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.386397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 866/1724] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:36.390073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.390678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.391018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.391296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.392105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa75c4-7d63-4829-9a36-46d457f73c7f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:36.406773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa75c4-7d63-4829-9a36-46d457f73c7f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.412426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca1765-f5b7-44a2-aecf-bc63d7ad3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.413229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1765-f5b7-44a2-aecf-bc63d7ad3947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.413744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1765-f5b7-44a2-aecf-bc63d7ad3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.414130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca1765-f5b7-44a2-aecf-bc63d7ad3947 admin admin] PATH_INFO: `/v3/projects/4910df3df0404d2cbf86fa2ea839d5f6/users/bad1c6be841940e2b2add4398e0ad1d0/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.417836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca1765-f5b7-44a2-aecf-bc63d7ad3947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4910df3df0404d2cbf86fa2ea839d5f6, user_id=bad1c6be841940e2b2add4398e0ad1d0, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.420654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca1765-f5b7-44a2-aecf-bc63d7ad3947 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.434266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 867/1725] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:36 2022] PUT /identity/v3/projects/4910df3df0404d2cbf86fa2ea839d5f6/users/bad1c6be841940e2b2add4398e0ad1d0/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:36.439022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:36.460156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b630-20ee-44ab-b37a-4c1b6d9f49de None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.460670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b630-20ee-44ab-b37a-4c1b6d9f49de None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.462332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b630-20ee-44ab-b37a-4c1b6d9f49de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.473570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.477409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.492279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 859/1726] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:36.502855 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0731b630-20ee-44ab-b37a-4c1b6d9f49de None None] MFA Rules not processed for user `bad1c6be841940e2b2add4398e0ad1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:36.504465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0731b630-20ee-44ab-b37a-4c1b6d9f49de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:36.617684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:36.619829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 868/1727] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:36.619947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:36.631268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731b630-20ee-44ab-b37a-4c1b6d9f49de None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:36.637712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b569-02f2-436c-bbe6-51cb12bbfae7 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.671771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:36.688875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731b630-20ee-44ab-b37a-4c1b6d9f49de None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.689707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.690311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.690586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.690852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.692919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd6fc-e2dd-4f50-9ae0-f5f6643574aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.693699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd6fc-e2dd-4f50-9ae0-f5f6643574aa service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.694010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd6fc-e2dd-4f50-9ae0-f5f6643574aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.694268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd6fc-e2dd-4f50-9ae0-f5f6643574aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.705304 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd6fc-e2dd-4f50-9ae0-f5f6643574aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.706871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd6fc-e2dd-4f50-9ae0-f5f6643574aa service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.718058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 869/1728] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:36.756243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.757718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.761298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd6fc-e2dd-4f50-9ae0-f5f6643574aa service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:36.767146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 860/1729] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:36.769898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd6fc-e2dd-4f50-9ae0-f5f6643574aa service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:36.773615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693198b7-84bb-4a40-83a7-c24bc83f7b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:36.774223 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693198b7-84bb-4a40-83a7-c24bc83f7b34 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:36.774501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693198b7-84bb-4a40-83a7-c24bc83f7b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:36.774773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693198b7-84bb-4a40-83a7-c24bc83f7b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:36.837339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693198b7-84bb-4a40-83a7-c24bc83f7b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:36.838897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693198b7-84bb-4a40-83a7-c24bc83f7b34 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:36.847882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 870/1730] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:39.270501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:39.272377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:39.341086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7707b9-a7a7-49b3-8480-50b3f80305e7 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:39.345514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:39.346307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:39.346652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:39.346983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] PATH_INFO: `/v3/users/04fd3ce020bb41dba50e9c4a2902b1a2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:39.348185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fd3ce020bb41dba50e9c4a2902b1a2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:39.350392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:39.386579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:39.401739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fd3ce020bb41dba50e9c4a2902b1a2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.414031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fd3ce020bb41dba50e9c4a2902b1a2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.414720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fd3ce020bb41dba50e9c4a2902b1a2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.422243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fd3ce020bb41dba50e9c4a2902b1a2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.422928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fd3ce020bb41dba50e9c4a2902b1a2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.436468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 861/1731] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:39 2022] DELETE /identity/v3/users/04fd3ce020bb41dba50e9c4a2902b1a2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:39.440942 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a13c-58a5-440a-9394-5a38329e92c5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:39.441423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a13c-58a5-440a-9394-5a38329e92c5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:39.441625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a13c-58a5-440a-9394-5a38329e92c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:39.460734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-82e3a13c-58a5-440a-9394-5a38329e92c5 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:39.462027 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-82e3a13c-58a5-440a-9394-5a38329e92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:39.522509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 871/1732] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:39.532672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:39.534142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:39.595181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3137-b248-488e-9adf-2f9676de8395 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:39.599648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1523d4-b046-4dd3-a332-5307fe87f34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:39.600281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1523d4-b046-4dd3-a332-5307fe87f34b service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:39.601522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1523d4-b046-4dd3-a332-5307fe87f34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:39.601983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1523d4-b046-4dd3-a332-5307fe87f34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:39.613080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1523d4-b046-4dd3-a332-5307fe87f34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:39.614719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1523d4-b046-4dd3-a332-5307fe87f34b service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:39.615071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3a13c-58a5-440a-9394-5a38329e92c5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:39.616641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-82e3a13c-58a5-440a-9394-5a38329e92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:39.625788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 862/1733] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:39.632349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3a13c-58a5-440a-9394-5a38329e92c5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:39.638186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:39.638962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:39.639352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:39.639713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] PATH_INFO: `/v3/users/f0ec5a7fdd3047468bdee3020f42646b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:39.641073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ec5a7fdd3047468bdee3020f42646b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:39.643127 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:39.699976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ec5a7fdd3047468bdee3020f42646b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.746301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ec5a7fdd3047468bdee3020f42646b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.747426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ec5a7fdd3047468bdee3020f42646b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.762086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ec5a7fdd3047468bdee3020f42646b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.763249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ec5a7fdd3047468bdee3020f42646b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:39.774894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:39.809566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 872/1734] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:39 2022] DELETE /identity/v3/users/f0ec5a7fdd3047468bdee3020f42646b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:39.812958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f003c-7bdc-484b-844a-1a59d15b588f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:39.813253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f003c-7bdc-484b-844a-1a59d15b588f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:39.814448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f003c-7bdc-484b-844a-1a59d15b588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:39.840820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-df5f003c-7bdc-484b-844a-1a59d15b588f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:39.842255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-df5f003c-7bdc-484b-844a-1a59d15b588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:39.965690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 863/1735] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:39.985427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:39.991709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:39.997436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f003c-7bdc-484b-844a-1a59d15b588f None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:39.998966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-df5f003c-7bdc-484b-844a-1a59d15b588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:40.030974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c31ba-060e-45c8-8bf8-a0e3a2a0d016 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:40.039849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:40.040705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:40.041631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:40.042139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] PATH_INFO: `/v3/projects/a3a10c7633864082a677ded8aa423fc9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:40.043635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a10c7633864082a677ded8aa423fc9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:40.046172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:40.085990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f003c-7bdc-484b-844a-1a59d15b588f None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:40.094800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:40.101513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:40.102064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:40.102502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:40.113259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:40.119322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a10c7633864082a677ded8aa423fc9', 'request_id': 'req-9bb10e65-735c-4660-98c5-781d0d33f698'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.121176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:40.122667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:40.137852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a10c7633864082a677ded8aa423fc9', 'request_id': 'req-9bb10e65-735c-4660-98c5-781d0d33f698'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.140357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 864/1736] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:40.141221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:40.142535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:40.145687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a10c7633864082a677ded8aa423fc9', 'request_id': 'req-9bb10e65-735c-4660-98c5-781d0d33f698'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.159995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045b0c3-f3b2-40d8-a69f-7361260b8492 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:40.170869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] The token cache is being invalidate because project a3a10c7633864082a677ded8aa423fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:40.171165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.171861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.176928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 873/1737] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:39 2022] DELETE /identity/v3/projects/a3a10c7633864082a677ded8aa423fc9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:40.181322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:40.184454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:40.232842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:40.233740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:40.234487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:40.234882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] PATH_INFO: `/v3/users/ef1b02a983d64b8983bc1f8f59c7ece9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:40.236278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1b02a983d64b8983bc1f8f59c7ece9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:40.238611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:40.347789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb10e65-735c-4660-98c5-781d0d33f698 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:40.356097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1b02a983d64b8983bc1f8f59c7ece9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.360181 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:40.360843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:40.361119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:40.361392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] PATH_INFO: `/v3/users/92de5bcc5d7e4beeb45e88da47f54564` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:40.364401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92de5bcc5d7e4beeb45e88da47f54564)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:40.366636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:40.371665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1b02a983d64b8983bc1f8f59c7ece9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.372671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1b02a983d64b8983bc1f8f59c7ece9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.382642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1b02a983d64b8983bc1f8f59c7ece9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.383621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-593e11c3-0d0e-41c0-8ea8-6c37e7126087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1b02a983d64b8983bc1f8f59c7ece9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.443751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 865/1738] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:40 2022] DELETE /identity/v3/users/ef1b02a983d64b8983bc1f8f59c7ece9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:40.449878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235551-b021-4717-9133-835fe824a959 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:40.451035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235551-b021-4717-9133-835fe824a959 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:40.451886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235551-b021-4717-9133-835fe824a959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:40.461464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92de5bcc5d7e4beeb45e88da47f54564'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.477387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92de5bcc5d7e4beeb45e88da47f54564'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.478443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92de5bcc5d7e4beeb45e88da47f54564'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.490966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92de5bcc5d7e4beeb45e88da47f54564'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.492101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92de5bcc5d7e4beeb45e88da47f54564'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.503581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:40.504682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-cb235551-b021-4717-9133-835fe824a959 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:40.505913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cb235551-b021-4717-9133-835fe824a959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:40.529321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 874/1739] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:40 2022] DELETE /identity/v3/users/92de5bcc5d7e4beeb45e88da47f54564 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:40.630718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 866/1740] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:40.652312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:40.652312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:40.654298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235551-b021-4717-9133-835fe824a959 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:40.656929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cb235551-b021-4717-9133-835fe824a959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:40.701241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235551-b021-4717-9133-835fe824a959 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:40.723015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:40.738870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17e32-f3eb-49ee-bb4c-23c33f63a970 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:40.743867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab870-b27a-4e36-a270-a18d8086dcec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:40.744605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab870-b27a-4e36-a270-a18d8086dcec service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:40.745000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab870-b27a-4e36-a270-a18d8086dcec service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:40.745182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab870-b27a-4e36-a270-a18d8086dcec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:40.826449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:40.827099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:40.827420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:40.827635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] PATH_INFO: `/v3/projects/60763b60510343e1805e2825f6959eb1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:40.828786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60763b60510343e1805e2825f6959eb1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:40.830734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:40.838376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ab870-b27a-4e36-a270-a18d8086dcec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:40.840150 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ab870-b27a-4e36-a270-a18d8086dcec service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:40.851068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 875/1741] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:40.879996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60763b60510343e1805e2825f6959eb1', 'request_id': 'req-df7b179e-ee43-4032-bbd9-569223b8a6f9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.886342 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60763b60510343e1805e2825f6959eb1', 'request_id': 'req-df7b179e-ee43-4032-bbd9-569223b8a6f9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.892614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60763b60510343e1805e2825f6959eb1', 'request_id': 'req-df7b179e-ee43-4032-bbd9-569223b8a6f9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.906639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] The token cache is being invalidate because project 60763b60510343e1805e2825f6959eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:40.907041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.907768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:40.909395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 867/1742] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:40 2022] DELETE /identity/v3/projects/60763b60510343e1805e2825f6959eb1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:40.913440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab870-b27a-4e36-a270-a18d8086dcec service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:40.923850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab870-b27a-4e36-a270-a18d8086dcec service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:40.945551 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:40.947143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:41.021891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:41.022533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:41.022979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:41.023308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] PATH_INFO: `/v3/users/1293a9faa51c4b6b8763842cd7a40b9f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:41.024667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1293a9faa51c4b6b8763842cd7a40b9f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:41.027212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:41.034873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b179e-ee43-4032-bbd9-569223b8a6f9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:41.040103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:41.040903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:41.041235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:41.041607 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] PATH_INFO: `/v3/projects/11cbbfdbc558448fb0b6d4f211499a8e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:41.042843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11cbbfdbc558448fb0b6d4f211499a8e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:41.044954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:41.097630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:41.103704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1293a9faa51c4b6b8763842cd7a40b9f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.110206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:41.116041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11cbbfdbc558448fb0b6d4f211499a8e', 'request_id': 'req-0d807a35-7b8e-48ae-a865-418d59ec64f1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.122290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1293a9faa51c4b6b8763842cd7a40b9f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.123498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1293a9faa51c4b6b8763842cd7a40b9f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.126007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11cbbfdbc558448fb0b6d4f211499a8e', 'request_id': 'req-0d807a35-7b8e-48ae-a865-418d59ec64f1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.132364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1293a9faa51c4b6b8763842cd7a40b9f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.133451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11cbbfdbc558448fb0b6d4f211499a8e', 'request_id': 'req-0d807a35-7b8e-48ae-a865-418d59ec64f1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.135322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1293a9faa51c4b6b8763842cd7a40b9f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.152762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 876/1743] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:40 2022] DELETE /identity/v3/users/1293a9faa51c4b6b8763842cd7a40b9f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:41.153241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] The token cache is being invalidate because project 11cbbfdbc558448fb0b6d4f211499a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:41.153733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.154502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.156492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 868/1744] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:40 2022] DELETE /identity/v3/projects/11cbbfdbc558448fb0b6d4f211499a8e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:41.161113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:41.163074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:41.260405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f45ab6-5c3c-4314-a5cc-0b77130440ff admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:41.269592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:41.270458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:41.270760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:41.271031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] PATH_INFO: `/v3/users/a0a2f1fc422e49f198a0ad9f90212fa1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:41.272180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a2f1fc422e49f198a0ad9f90212fa1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:41.275159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:41.276266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:41.278978 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:41.340628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a2f1fc422e49f198a0ad9f90212fa1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.356263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a2f1fc422e49f198a0ad9f90212fa1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.357016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a2f1fc422e49f198a0ad9f90212fa1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.367033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a2f1fc422e49f198a0ad9f90212fa1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.367760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a2f1fc422e49f198a0ad9f90212fa1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.383431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d807a35-7b8e-48ae-a865-418d59ec64f1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:41.387459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 877/1745] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:41 2022] DELETE /identity/v3/users/a0a2f1fc422e49f198a0ad9f90212fa1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:41.389344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:41.389890 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:41.397768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:41.398054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] PATH_INFO: `/v3/projects/5100034280f14d728d09d4a971c7096c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:41.401099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5100034280f14d728d09d4a971c7096c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:41.403126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:41.475520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:41.479576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:41.490387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5100034280f14d728d09d4a971c7096c', 'request_id': 'req-27c76b10-cbce-4470-a09b-72d4b00abf23'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.496851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5100034280f14d728d09d4a971c7096c', 'request_id': 'req-27c76b10-cbce-4470-a09b-72d4b00abf23'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.512051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5100034280f14d728d09d4a971c7096c', 'request_id': 'req-27c76b10-cbce-4470-a09b-72d4b00abf23'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.531453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] The token cache is being invalidate because project 5100034280f14d728d09d4a971c7096c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:41.531817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.532722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.534617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 869/1746] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:41 2022] DELETE /identity/v3/projects/5100034280f14d728d09d4a971c7096c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:41.538525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:41.540044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:41.554099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:41.594299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a88ff-cc1a-4571-b476-9d6565f5cf30 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:41.645040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c76b10-cbce-4470-a09b-72d4b00abf23 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:41.653106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:41.654415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:41.655084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:41.655560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] PATH_INFO: `/v3/users/03f07f1389c04b708004126223f7605d` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:41.657532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f07f1389c04b708004126223f7605d)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:41.660511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:41.678172 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:41.718153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:41.719260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:41.720018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:41.720224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] PATH_INFO: `/v3/projects/52a1e1fbe4774a7081c17bc2ff90dd2e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:41.721960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a1e1fbe4774a7081c17bc2ff90dd2e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:41.726870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:41.780477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f07f1389c04b708004126223f7605d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.802843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f07f1389c04b708004126223f7605d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.803679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f07f1389c04b708004126223f7605d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.821114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f07f1389c04b708004126223f7605d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.822065 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f07f1389c04b708004126223f7605d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.834481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a1e1fbe4774a7081c17bc2ff90dd2e', 'request_id': 'req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.842618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a1e1fbe4774a7081c17bc2ff90dd2e', 'request_id': 'req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.847312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 870/1747] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:41 2022] DELETE /identity/v3/users/03f07f1389c04b708004126223f7605d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:41.850627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:41.853363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:41.863123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a1e1fbe4774a7081c17bc2ff90dd2e', 'request_id': 'req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.886414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] The token cache is being invalidate because project 52a1e1fbe4774a7081c17bc2ff90dd2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:41.886710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.887967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9b267aaf-bba9-4dfc-8c33-1985f5b3fcd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:41.891091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 878/1748] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:41 2022] DELETE /identity/v3/projects/52a1e1fbe4774a7081c17bc2ff90dd2e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:41.897750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287de2a-9bd8-42cd-863c-ff1a3e8f7d3b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:41.898344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287de2a-9bd8-42cd-863c-ff1a3e8f7d3b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:41.900112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287de2a-9bd8-42cd-863c-ff1a3e8f7d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:41.927066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9287de2a-9bd8-42cd-863c-ff1a3e8f7d3b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:41.928644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9287de2a-9bd8-42cd-863c-ff1a3e8f7d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:41.997003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0fa31-1f34-4d14-ba43-4871b8f71da4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.002667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.003517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.003869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.004240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] PATH_INFO: `/v3/projects/fd0b39ff3a2a4b83ae4c294cf20b2b08` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.004966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 879/1749] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:42.006081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0b39ff3a2a4b83ae4c294cf20b2b08)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.008069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.015056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b607d2-74f7-4a52-bd00-6b561f5a7807 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.015910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b607d2-74f7-4a52-bd00-6b561f5a7807 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.017053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b607d2-74f7-4a52-bd00-6b561f5a7807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.047009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d6b607d2-74f7-4a52-bd00-6b561f5a7807 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:42.049352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d6b607d2-74f7-4a52-bd00-6b561f5a7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.071445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 880/1750] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:42.075290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0b39ff3a2a4b83ae4c294cf20b2b08', 'request_id': 'req-bf76e415-5f2b-4476-88f9-8810cc46b203'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.076555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b607d2-74f7-4a52-bd00-6b561f5a7807 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.082852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0b39ff3a2a4b83ae4c294cf20b2b08', 'request_id': 'req-bf76e415-5f2b-4476-88f9-8810cc46b203'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.089150 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b607d2-74f7-4a52-bd00-6b561f5a7807 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.091627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0b39ff3a2a4b83ae4c294cf20b2b08', 'request_id': 'req-bf76e415-5f2b-4476-88f9-8810cc46b203'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.100561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:42.110899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] The token cache is being invalidate because project fd0b39ff3a2a4b83ae4c294cf20b2b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:42.111618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.112691 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-bf76e415-5f2b-4476-88f9-8810cc46b203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.116239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 871/1751] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:41 2022] DELETE /identity/v3/projects/fd0b39ff3a2a4b83ae4c294cf20b2b08 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:42.123530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d86b-d4f4-47ab-b878-087b1070159b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.123862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d86b-d4f4-47ab-b878-087b1070159b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.124078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257d86b-d4f4-47ab-b878-087b1070159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.152669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-e257d86b-d4f4-47ab-b878-087b1070159b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:42.155209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e257d86b-d4f4-47ab-b878-087b1070159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.167089 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:42.174510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.175156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.175402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.176722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.177345 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:42.177814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.180186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.200031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 881/1752] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:42.210408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.216086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.262835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 872/1753] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:42.263852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257d86b-d4f4-47ab-b878-087b1070159b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.265444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e257d86b-d4f4-47ab-b878-087b1070159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.270786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b7e19-205a-4fa9-963d-401a244ecbfd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.278534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257d86b-d4f4-47ab-b878-087b1070159b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.278805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fa404-b758-483f-87a3-3b7433ee149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.279611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa404-b758-483f-87a3-3b7433ee149c admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.280041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa404-b758-483f-87a3-3b7433ee149c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.280473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa404-b758-483f-87a3-3b7433ee149c admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.281266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fa404-b758-483f-87a3-3b7433ee149c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.283525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fa404-b758-483f-87a3-3b7433ee149c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.283960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.284791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.285144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.285706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] PATH_INFO: `/v3/projects/464f7e536339467fa1cefb091bb2f13d` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.286966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=464f7e536339467fa1cefb091bb2f13d)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.292594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.327134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 882/1754] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:42 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:42.330315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec309-4a38-4eeb-872f-e281da6309f2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.330315 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec309-4a38-4eeb-872f-e281da6309f2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.330603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec309-4a38-4eeb-872f-e281da6309f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.362821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464f7e536339467fa1cefb091bb2f13d', 'request_id': 'req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.373309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464f7e536339467fa1cefb091bb2f13d', 'request_id': 'req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.380787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-69cec309-4a38-4eeb-872f-e281da6309f2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:42.382136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-69cec309-4a38-4eeb-872f-e281da6309f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.385775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464f7e536339467fa1cefb091bb2f13d', 'request_id': 'req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.418858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] The token cache is being invalidate because project 464f7e536339467fa1cefb091bb2f13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:42.419270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.419885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.424590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 873/1755] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:42 2022] DELETE /identity/v3/projects/464f7e536339467fa1cefb091bb2f13d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:42.424590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.425670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.459004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 883/1756] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:42.460858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec309-4a38-4eeb-872f-e281da6309f2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.462094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-69cec309-4a38-4eeb-872f-e281da6309f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.475161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec309-4a38-4eeb-872f-e281da6309f2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.480290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.481086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.481363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.481673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] PATH_INFO: `/v3/users/bad1c6be841940e2b2add4398e0ad1d0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.482830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad1c6be841940e2b2add4398e0ad1d0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.485294 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.521809 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff3a10-ea07-41f2-ac1b-a5550630f4c1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.526815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389115e-46c4-428b-a9fe-52d4a07a8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.527421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389115e-46c4-428b-a9fe-52d4a07a8329 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.527695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389115e-46c4-428b-a9fe-52d4a07a8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.527963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389115e-46c4-428b-a9fe-52d4a07a8329 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.528628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389115e-46c4-428b-a9fe-52d4a07a8329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.530578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389115e-46c4-428b-a9fe-52d4a07a8329 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.540239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad1c6be841940e2b2add4398e0ad1d0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.553223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 874/1757] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:42 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:42.554050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389115e-46c4-428b-a9fe-52d4a07a8329 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.563165 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad1c6be841940e2b2add4398e0ad1d0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.563904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad1c6be841940e2b2add4398e0ad1d0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.565561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389115e-46c4-428b-a9fe-52d4a07a8329 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.570691 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.571304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.571583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.571994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.572532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad1c6be841940e2b2add4398e0ad1d0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.572645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:42.572860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.573562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad1c6be841940e2b2add4398e0ad1d0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:42.574497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.579736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:42.589436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 875/1758] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:42.590382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.592517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.593276 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 884/1759] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:42 2022] DELETE /identity/v3/users/bad1c6be841940e2b2add4398e0ad1d0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:42.605944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.606346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23ae18-ad59-4b3c-9426-dc1b4def8a62 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.607464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:42.620644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:42.702744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec871-2f82-466a-ac05-12495f8b3916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.703362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec871-2f82-466a-ac05-12495f8b3916 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.703640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec871-2f82-466a-ac05-12495f8b3916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.703910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec871-2f82-466a-ac05-12495f8b3916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.704563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec871-2f82-466a-ac05-12495f8b3916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.706855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec871-2f82-466a-ac05-12495f8b3916 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.720757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 876/1760] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:42.724881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec871-2f82-466a-ac05-12495f8b3916 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.729198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2a34-b5e6-4db3-9616-c8e3e4ce6b44 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.738240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec871-2f82-466a-ac05-12495f8b3916 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.743502 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f1df-25ec-479d-b247-36fc3c1a6b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.744231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ddfb7-5c83-4ca1-bf62-cce777cb320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.744390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f1df-25ec-479d-b247-36fc3c1a6b3d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.744643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f1df-25ec-479d-b247-36fc3c1a6b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.745083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ddfb7-5c83-4ca1-bf62-cce777cb320a admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.745218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f1df-25ec-479d-b247-36fc3c1a6b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.745474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ddfb7-5c83-4ca1-bf62-cce777cb320a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.745816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ddfb7-5c83-4ca1-bf62-cce777cb320a admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.745919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61f1df-25ec-479d-b247-36fc3c1a6b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.746545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ddfb7-5c83-4ca1-bf62-cce777cb320a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.747874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61f1df-25ec-479d-b247-36fc3c1a6b3d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.748182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ddfb7-5c83-4ca1-bf62-cce777cb320a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.784293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 877/1761] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:42.790307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ddfb7-5c83-4ca1-bf62-cce777cb320a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.795617 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 885/1762] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:42 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:42.799791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f1df-25ec-479d-b247-36fc3c1a6b3d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.816082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ddfb7-5c83-4ca1-bf62-cce777cb320a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.880066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f1df-25ec-479d-b247-36fc3c1a6b3d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.886656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1fbf-d762-4360-87a9-56173f56f57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.887561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1fbf-d762-4360-87a9-56173f56f57b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.887842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1fbf-d762-4360-87a9-56173f56f57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.888117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf1fbf-d762-4360-87a9-56173f56f57b admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.888823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1fbf-d762-4360-87a9-56173f56f57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.891450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf1fbf-d762-4360-87a9-56173f56f57b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.901741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36912f4f-43fe-473d-9ec3-84a72b233be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:42.902524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36912f4f-43fe-473d-9ec3-84a72b233be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.902877 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36912f4f-43fe-473d-9ec3-84a72b233be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.903235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36912f4f-43fe-473d-9ec3-84a72b233be9 admin admin] PATH_INFO: `/v3/projects/43ffa94584a04ce1a6a8e2542440658e/users/6981107ea201498cb37fe79da05116a1/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:42.921047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 886/1763] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:42 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:42.922509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36912f4f-43fe-473d-9ec3-84a72b233be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ffa94584a04ce1a6a8e2542440658e, user_id=6981107ea201498cb37fe79da05116a1, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:42.925340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1fbf-d762-4360-87a9-56173f56f57b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:42.925829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36912f4f-43fe-473d-9ec3-84a72b233be9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:42.938683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf1fbf-d762-4360-87a9-56173f56f57b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:42.945519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 878/1764] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:42 2022] PUT /identity/v3/projects/43ffa94584a04ce1a6a8e2542440658e/users/6981107ea201498cb37fe79da05116a1/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:42.956638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4721cc-7f05-4a92-aa95-ccfd416f9a5b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:42.957451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4721cc-7f05-4a92-aa95-ccfd416f9a5b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:42.958498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4721cc-7f05-4a92-aa95-ccfd416f9a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.007434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-dc4721cc-7f05-4a92-aa95-ccfd416f9a5b None None] MFA Rules not processed for user `6981107ea201498cb37fe79da05116a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:43.010202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-dc4721cc-7f05-4a92-aa95-ccfd416f9a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:43.029896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8479120-ce28-4f47-a817-2002daedb1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.030518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8479120-ce28-4f47-a817-2002daedb1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.030791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8479120-ce28-4f47-a817-2002daedb1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.032118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8479120-ce28-4f47-a817-2002daedb1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.032423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8479120-ce28-4f47-a817-2002daedb1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.034256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8479120-ce28-4f47-a817-2002daedb1a4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.049789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 887/1765] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:43.050828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8479120-ce28-4f47-a817-2002daedb1a4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.062752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8479120-ce28-4f47-a817-2002daedb1a4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:43.068458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef4a3-d4e0-45d9-82f6-69f4a8b61536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.069120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef4a3-d4e0-45d9-82f6-69f4a8b61536 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.069406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef4a3-d4e0-45d9-82f6-69f4a8b61536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.069830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef4a3-d4e0-45d9-82f6-69f4a8b61536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.070592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef4a3-d4e0-45d9-82f6-69f4a8b61536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.072864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef4a3-d4e0-45d9-82f6-69f4a8b61536 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.074557 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:43.089108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 879/1766] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:43.089365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 888/1767] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:43.093863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4721cc-7f05-4a92-aa95-ccfd416f9a5b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.094709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef4a3-d4e0-45d9-82f6-69f4a8b61536 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.104723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4721cc-7f05-4a92-aa95-ccfd416f9a5b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:43.108298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef4a3-d4e0-45d9-82f6-69f4a8b61536 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:43.110264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754b3dd-3460-4b0d-afab-f3236e1f41a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.110843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754b3dd-3460-4b0d-afab-f3236e1f41a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.111124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754b3dd-3460-4b0d-afab-f3236e1f41a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.111400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754b3dd-3460-4b0d-afab-f3236e1f41a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.112039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754b3dd-3460-4b0d-afab-f3236e1f41a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.113993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754b3dd-3460-4b0d-afab-f3236e1f41a9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.114722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4c3ff-9b3f-484a-a5f5-0645d319793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.115454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4c3ff-9b3f-484a-a5f5-0645d319793d admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.115926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4c3ff-9b3f-484a-a5f5-0645d319793d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.116278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4c3ff-9b3f-484a-a5f5-0645d319793d admin admin] PATH_INFO: `/v3/projects/a27731b708cd4bae8e4219d2b52e457f/users/c3b1bf39290345a58aed7d2b2606d9b8/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.124400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:43.138523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4c3ff-9b3f-484a-a5f5-0645d319793d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27731b708cd4bae8e4219d2b52e457f, user_id=c3b1bf39290345a58aed7d2b2606d9b8, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.141884 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4c3ff-9b3f-484a-a5f5-0645d319793d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.146078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 880/1768] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:43 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:43.149977 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754b3dd-3460-4b0d-afab-f3236e1f41a9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.161077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 889/1769] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:43 2022] PUT /identity/v3/projects/a27731b708cd4bae8e4219d2b52e457f/users/c3b1bf39290345a58aed7d2b2606d9b8/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:43.172382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2fafa-04fb-42a6-b3f4-ed4505f26db9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.172724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2fafa-04fb-42a6-b3f4-ed4505f26db9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.173103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2fafa-04fb-42a6-b3f4-ed4505f26db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.207131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-afb2fafa-04fb-42a6-b3f4-ed4505f26db9 None None] MFA Rules not processed for user `c3b1bf39290345a58aed7d2b2606d9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:43.208664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-afb2fafa-04fb-42a6-b3f4-ed4505f26db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:43.231212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754b3dd-3460-4b0d-afab-f3236e1f41a9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:43.330004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.330999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.331287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.331563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.332777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.332893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 890/1770] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:43.334542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2fafa-04fb-42a6-b3f4-ed4505f26db9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.339089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-afb2fafa-04fb-42a6-b3f4-ed4505f26db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:43.339912 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.370974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2fafa-04fb-42a6-b3f4-ed4505f26db9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:43.375318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 881/1771] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:43 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:43.376264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.378122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:43.386468 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.387141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.387426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.387755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] PATH_INFO: `/v3/projects/4910df3df0404d2cbf86fa2ea839d5f6` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.388953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4910df3df0404d2cbf86fa2ea839d5f6)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.392149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.528416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4910df3df0404d2cbf86fa2ea839d5f6', 'request_id': 'req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:43.541829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4910df3df0404d2cbf86fa2ea839d5f6', 'request_id': 'req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:43.553268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4910df3df0404d2cbf86fa2ea839d5f6', 'request_id': 'req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:43.577390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924537-4dc9-41d2-a492-bcfecb9d9a9f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:43.582794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] The token cache is being invalidate because project 4910df3df0404d2cbf86fa2ea839d5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:43.583549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:43.584667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:43.586503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 891/1772] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:43 2022] DELETE /identity/v3/projects/4910df3df0404d2cbf86fa2ea839d5f6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:43.587392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.589060 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:43.623703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:43.678314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:43.700068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3e66e-6f09-4d35-b97d-7a328c84579c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3697284166c042d79d946ef469932562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.702530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e66e-6f09-4d35-b97d-7a328c84579c service glance] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.702948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e66e-6f09-4d35-b97d-7a328c84579c service glance] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.704118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e66e-6f09-4d35-b97d-7a328c84579c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.708445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-06b3e66e-6f09-4d35-b97d-7a328c84579c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:43.716745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990dc3-3269-4d47-9ea5-0e39fd76cd12 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:43.742311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71613a2a-ec80-49ec-8a67-e2719ffd2fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.742954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71613a2a-ec80-49ec-8a67-e2719ffd2fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.743237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71613a2a-ec80-49ec-8a67-e2719ffd2fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.743509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71613a2a-ec80-49ec-8a67-e2719ffd2fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.745742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71613a2a-ec80-49ec-8a67-e2719ffd2fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.747409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71613a2a-ec80-49ec-8a67-e2719ffd2fe2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.767272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 892/1773] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:43.769103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca606f-19aa-4b10-a27d-a44f20e06f5c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.769624 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca606f-19aa-4b10-a27d-a44f20e06f5c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.770103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca606f-19aa-4b10-a27d-a44f20e06f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.806852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d4ca606f-19aa-4b10-a27d-a44f20e06f5c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:43.808102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d4ca606f-19aa-4b10-a27d-a44f20e06f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:43.819841 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 893/1774] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:43.826658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca606f-19aa-4b10-a27d-a44f20e06f5c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.832191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca606f-19aa-4b10-a27d-a44f20e06f5c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:43.832841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3e66e-6f09-4d35-b97d-7a328c84579c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.838414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3e66e-6f09-4d35-b97d-7a328c84579c service glance] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.839673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:43.840528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.840954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.841576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] PATH_INFO: `/v3/projects/1b8775df79d8489d8590ef71923b6eff/users/3afe9831def4429d99dbbe599c75e7e9/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.860164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 882/1775] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:43.861828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c8d1-8730-42d6-b337-684eebaa88d5 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:43.862576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c8d1-8730-42d6-b337-684eebaa88d5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:43.862863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46c8d1-8730-42d6-b337-684eebaa88d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:43.873692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8775df79d8489d8590ef71923b6eff, user_id=3afe9831def4429d99dbbe599c75e7e9, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:43.880673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:43.913781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 894/1776] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:43 2022] PUT /identity/v3/projects/1b8775df79d8489d8590ef71923b6eff/users/3afe9831def4429d99dbbe599c75e7e9/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:43.915541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:43.917693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-3a46c8d1-8730-42d6-b337-684eebaa88d5 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:43.917939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:43.918885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3a46c8d1-8730-42d6-b337-684eebaa88d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:44.051593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd13a47-71fc-4e67-8b74-628446037500 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:44.067439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:44.067812 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.068087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.068360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] PATH_INFO: `/v3/users/f14a3a7cd7444250ad9d27f7727de19d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.069605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14a3a7cd7444250ad9d27f7727de19d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:44.072936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:44.144138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 883/1777] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:44.145086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46c8d1-8730-42d6-b337-684eebaa88d5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:44.172202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46c8d1-8730-42d6-b337-684eebaa88d5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:44.185464 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6133e47-c343-42bc-98f9-5dd73e0b0848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:44.186131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6133e47-c343-42bc-98f9-5dd73e0b0848 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.186409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6133e47-c343-42bc-98f9-5dd73e0b0848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.186731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6133e47-c343-42bc-98f9-5dd73e0b0848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.187393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6133e47-c343-42bc-98f9-5dd73e0b0848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:44.189002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6133e47-c343-42bc-98f9-5dd73e0b0848 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:44.191135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14a3a7cd7444250ad9d27f7727de19d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:44.206217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 884/1778] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:44.207496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6133e47-c343-42bc-98f9-5dd73e0b0848 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:44.220497 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6133e47-c343-42bc-98f9-5dd73e0b0848 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:44.228602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:44.229731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.230206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.230745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.231656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:44.232190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:44.236920 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:44.252304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 885/1779] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:44.253567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:44.258933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14a3a7cd7444250ad9d27f7727de19d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:44.261472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14a3a7cd7444250ad9d27f7727de19d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:44.276815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14a3a7cd7444250ad9d27f7727de19d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:44.277535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14a3a7cd7444250ad9d27f7727de19d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:44.284734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d86b76-d8b7-4126-a347-83ded617fe9a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:44.291834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d8ff3-0d62-46af-9ef0-832af61b9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:44.292841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d8ff3-0d62-46af-9ef0-832af61b9efe admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.293289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d8ff3-0d62-46af-9ef0-832af61b9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.293791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d8ff3-0d62-46af-9ef0-832af61b9efe admin admin] PATH_INFO: `/v3/projects/1b8775df79d8489d8590ef71923b6eff/users/3afe9831def4429d99dbbe599c75e7e9/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.296158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d8ff3-0d62-46af-9ef0-832af61b9efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8775df79d8489d8590ef71923b6eff, user_id=3afe9831def4429d99dbbe599c75e7e9, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:44.299339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d8ff3-0d62-46af-9ef0-832af61b9efe admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:44.314891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 895/1780] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:43 2022] DELETE /identity/v3/users/f14a3a7cd7444250ad9d27f7727de19d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:44.315747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:44.320359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:44.323683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 886/1781] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:44 2022] PUT /identity/v3/projects/1b8775df79d8489d8590ef71923b6eff/users/3afe9831def4429d99dbbe599c75e7e9/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:44.326337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1755b5-937a-45e4-8c78-2d6a5378f779 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.326794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1755b5-937a-45e4-8c78-2d6a5378f779 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.327068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1755b5-937a-45e4-8c78-2d6a5378f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.355241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5c1755b5-937a-45e4-8c78-2d6a5378f779 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:44.356719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5c1755b5-937a-45e4-8c78-2d6a5378f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:44.420131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:44.427839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:44.504282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 887/1782] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:44.504282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5a4e-7e94-4900-a624-90ecdcd8632f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.504282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5a4e-7e94-4900-a624-90ecdcd8632f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.504282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a5a4e-7e94-4900-a624-90ecdcd8632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.534150 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a7fee-678b-4d5e-8d97-2b68564b5ea1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:44.549961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:44.553553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.554016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.554695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.557024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:44.562229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:44.571355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-006a5a4e-7e94-4900-a624-90ecdcd8632f None None] MFA Rules not processed for user `3afe9831def4429d99dbbe599c75e7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:44.574001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-006a5a4e-7e94-4900-a624-90ecdcd8632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:44.639400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 896/1783] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:44 2022] POST /identity/v3/projects => generated 385 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:44.640382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:44.646765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:44.726553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 888/1784] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:44.727431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a5a4e-7e94-4900-a624-90ecdcd8632f None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:44.748569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a5a4e-7e94-4900-a624-90ecdcd8632f None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:44.814112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c6d7f-218c-4847-88bc-11daf4859add admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:44.821410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3adc-4adb-43f7-b109-09ad16ffc6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:44.822624 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3adc-4adb-43f7-b109-09ad16ffc6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.822897 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3adc-4adb-43f7-b109-09ad16ffc6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.825089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f3adc-4adb-43f7-b109-09ad16ffc6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.891526 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:44.892384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:44.892869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:44.893424 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:44.894744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:44.897322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:44.957448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 889/1785] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:44 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:44.958423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:44.963121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:44.996180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f3adc-4adb-43f7-b109-09ad16ffc6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:44.998001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f3adc-4adb-43f7-b109-09ad16ffc6d2 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.011340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 897/1786] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:45.011970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3adc-4adb-43f7-b109-09ad16ffc6d2 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:45.024512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f3adc-4adb-43f7-b109-09ad16ffc6d2 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.029692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183a8e-913f-49d0-bab1-ca9092817a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:45.030317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183a8e-913f-49d0-bab1-ca9092817a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.030595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183a8e-913f-49d0-bab1-ca9092817a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.030868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183a8e-913f-49d0-bab1-ca9092817a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.031519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1183a8e-913f-49d0-bab1-ca9092817a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:45.033138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1183a8e-913f-49d0-bab1-ca9092817a8e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.061657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 898/1787] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:45.063111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183a8e-913f-49d0-bab1-ca9092817a8e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:45.089935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183a8e-913f-49d0-bab1-ca9092817a8e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.101695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef20d58-0cd7-4638-8df1-aa1a34ea878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:45.104592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef20d58-0cd7-4638-8df1-aa1a34ea878d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.104889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef20d58-0cd7-4638-8df1-aa1a34ea878d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.105143 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef20d58-0cd7-4638-8df1-aa1a34ea878d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.107316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef20d58-0cd7-4638-8df1-aa1a34ea878d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:45.111745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef20d58-0cd7-4638-8df1-aa1a34ea878d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.118790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca772ec-b404-4712-aacb-1735c1d31ea1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.132550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e09f-fca0-4cea-9e59-fe9c42ae31b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:45.133883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e09f-fca0-4cea-9e59-fe9c42ae31b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.134512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e09f-fca0-4cea-9e59-fe9c42ae31b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.134630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 899/1788] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:45.137832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8e09f-fca0-4cea-9e59-fe9c42ae31b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.138671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef20d58-0cd7-4638-8df1-aa1a34ea878d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:45.154430 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef20d58-0cd7-4638-8df1-aa1a34ea878d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.158745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:45.162670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27a250-0ba1-4d1b-ba14-a4300780ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:45.163766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a250-0ba1-4d1b-ba14-a4300780ae0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.164239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a250-0ba1-4d1b-ba14-a4300780ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.166546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27a250-0ba1-4d1b-ba14-a4300780ae0c admin admin] PATH_INFO: `/v3/projects/c47ab7457f21424dbda3a8522819ac6a/users/18caa79810744c4a9d16c2044ff1f9a1/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.209387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27a250-0ba1-4d1b-ba14-a4300780ae0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47ab7457f21424dbda3a8522819ac6a, user_id=18caa79810744c4a9d16c2044ff1f9a1, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:45.213538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27a250-0ba1-4d1b-ba14-a4300780ae0c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.243348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 900/1789] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:45 2022] PUT /identity/v3/projects/c47ab7457f21424dbda3a8522819ac6a/users/18caa79810744c4a9d16c2044ff1f9a1/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:45.256787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916864-487f-4fc2-ac6c-97ca1cbb5bc3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.256787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916864-487f-4fc2-ac6c-97ca1cbb5bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.257086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916864-487f-4fc2-ac6c-97ca1cbb5bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.304951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8e09f-fca0-4cea-9e59-fe9c42ae31b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:45.306450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8e09f-fca0-4cea-9e59-fe9c42ae31b7 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.307319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d7916864-487f-4fc2-ac6c-97ca1cbb5bc3 None None] MFA Rules not processed for user `18caa79810744c4a9d16c2044ff1f9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:45.309203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d7916864-487f-4fc2-ac6c-97ca1cbb5bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:45.320786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 890/1790] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:45.325984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:45.470528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 901/1791] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:45.471702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e09f-fca0-4cea-9e59-fe9c42ae31b7 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:45.485125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8e09f-fca0-4cea-9e59-fe9c42ae31b7 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.577378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5717b28-25e0-4225-bec2-b1002320d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:45.579003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5717b28-25e0-4225-bec2-b1002320d499 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.579003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5717b28-25e0-4225-bec2-b1002320d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.579003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5717b28-25e0-4225-bec2-b1002320d499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.579547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5717b28-25e0-4225-bec2-b1002320d499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:45.581761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5717b28-25e0-4225-bec2-b1002320d499 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.629770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 891/1792] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:45 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:45.631013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7916864-487f-4fc2-ac6c-97ca1cbb5bc3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:45.644406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7916864-487f-4fc2-ac6c-97ca1cbb5bc3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.749749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:45.750413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.750694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.751057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.751756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:45.754390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.815263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 902/1793] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:45 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:45.820154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5717b28-25e0-4225-bec2-b1002320d499 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:45.832289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:45.834680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:45.848920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654012f-0c92-4cc6-8b2b-b6093511697a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.852895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5717b28-25e0-4225-bec2-b1002320d499 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.856892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:45.859035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.859035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.859035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] PATH_INFO: `/v3/projects/339947ece80d41259a0486bb5d9ef01f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.860112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339947ece80d41259a0486bb5d9ef01f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:45.862528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.877516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917df930-3d08-4488-b092-72b457d745da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:45.878111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df930-3d08-4488-b092-72b457d745da admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:45.878394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df930-3d08-4488-b092-72b457d745da admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:45.878662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917df930-3d08-4488-b092-72b457d745da admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:45.879319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917df930-3d08-4488-b092-72b457d745da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:45.890426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917df930-3d08-4488-b092-72b457d745da admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:45.925326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 892/1794] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:45.930241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917df930-3d08-4488-b092-72b457d745da admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:45.949190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917df930-3d08-4488-b092-72b457d745da admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:45.996452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339947ece80d41259a0486bb5d9ef01f', 'request_id': 'req-6a1b2c98-b811-46d8-b300-6759a76976a5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.005536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339947ece80d41259a0486bb5d9ef01f', 'request_id': 'req-6a1b2c98-b811-46d8-b300-6759a76976a5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.014890 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339947ece80d41259a0486bb5d9ef01f', 'request_id': 'req-6a1b2c98-b811-46d8-b300-6759a76976a5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.033006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] The token cache is being invalidate because project 339947ece80d41259a0486bb5d9ef01f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:46.033297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.034028 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.036085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 903/1795] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:45 2022] DELETE /identity/v3/projects/339947ece80d41259a0486bb5d9ef01f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:46.087037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:46.088224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:46.089128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:46.089415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] PATH_INFO: `/v3/projects/ce05c80624b748e5aa4236a63b4dff50/users/f7772f3f15c74c75b16ce6500285352f/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:46.098392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:46.099949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:46.114012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce05c80624b748e5aa4236a63b4dff50, user_id=f7772f3f15c74c75b16ce6500285352f, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:46.117214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b2c98-b811-46d8-b300-6759a76976a5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:46.117585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:46.125642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:46.126658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:46.126995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:46.127245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] PATH_INFO: `/v3/users/6981107ea201498cb37fe79da05116a1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:46.130369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6981107ea201498cb37fe79da05116a1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:46.133065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:46.140450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 893/1796] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:45 2022] PUT /identity/v3/projects/ce05c80624b748e5aa4236a63b4dff50/users/f7772f3f15c74c75b16ce6500285352f/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:46.144273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:46.146186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:46.159035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:46.168073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:46.248247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6981107ea201498cb37fe79da05116a1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.262985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6981107ea201498cb37fe79da05116a1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.264007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6981107ea201498cb37fe79da05116a1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.270495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660a89-51d7-4350-b59d-bd719b903f77 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:46.276926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:46.277583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:46.277872 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:46.278148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:46.278816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:46.280452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:46.293571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 894/1797] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:46.297690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:46.299597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:46.305316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6981107ea201498cb37fe79da05116a1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.306700 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-913395f6-a0ad-41c0-9874-afad57ed732d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6981107ea201498cb37fe79da05116a1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:46.316367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4b969-9c93-47b5-afed-5a0e5ab52f90 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:46.321363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bad43-9e56-428f-b7d1-08644276b6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:46.322148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bad43-9e56-428f-b7d1-08644276b6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:46.322547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bad43-9e56-428f-b7d1-08644276b6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:46.322830 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bad43-9e56-428f-b7d1-08644276b6ef admin admin] PATH_INFO: `/v3/projects/ce05c80624b748e5aa4236a63b4dff50/users/f7772f3f15c74c75b16ce6500285352f/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:46.325079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bad43-9e56-428f-b7d1-08644276b6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce05c80624b748e5aa4236a63b4dff50, user_id=f7772f3f15c74c75b16ce6500285352f, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:46.327937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bad43-9e56-428f-b7d1-08644276b6ef admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:46.342631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 904/1798] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:46 2022] DELETE /identity/v3/users/6981107ea201498cb37fe79da05116a1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:46.345627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 895/1799] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:46 2022] PUT /identity/v3/projects/ce05c80624b748e5aa4236a63b4dff50/users/f7772f3f15c74c75b16ce6500285352f/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:46.348266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dff83-3c40-46ca-a0be-c63691cfecbf None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:46.348706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dff83-3c40-46ca-a0be-c63691cfecbf None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:46.349106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dff83-3c40-46ca-a0be-c63691cfecbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:46.355453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de850b0-ccd6-4fd9-a3f8-542559c6f18b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:46.355737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de850b0-ccd6-4fd9-a3f8-542559c6f18b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:46.356009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de850b0-ccd6-4fd9-a3f8-542559c6f18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:46.377569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8d9dff83-3c40-46ca-a0be-c63691cfecbf None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:46.379413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8d9dff83-3c40-46ca-a0be-c63691cfecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:46.390814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5de850b0-ccd6-4fd9-a3f8-542559c6f18b None None] MFA Rules not processed for user `f7772f3f15c74c75b16ce6500285352f`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:46.392683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5de850b0-ccd6-4fd9-a3f8-542559c6f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:46.496379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 905/1800] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:46.520694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 896/1801] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:46.526997 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dff83-3c40-46ca-a0be-c63691cfecbf None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:46.529090 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8d9dff83-3c40-46ca-a0be-c63691cfecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:46.538621 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de850b0-ccd6-4fd9-a3f8-542559c6f18b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:46.547319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5de850b0-ccd6-4fd9-a3f8-542559c6f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:46.619386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de850b0-ccd6-4fd9-a3f8-542559c6f18b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:46.623150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:46.623774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:46.624049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:46.624325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:46.648766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:46.650475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dff83-3c40-46ca-a0be-c63691cfecbf None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:46.651171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:46.662483 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:46.663126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:46.663407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:46.663678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:46.682552 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:46.684061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:46.694033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 897/1802] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:46.710923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 906/1803] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:47.235813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:47.237421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:47.258317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:47.261174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:47.280417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906f813-9906-412e-a1fb-51912bae6f82 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:47.282283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaff63c-d597-4fe5-a0a4-b80b7510cabc service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:47.285439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:47.286154 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:47.286591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:47.286808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] PATH_INFO: `/v3/users/4a23786597854812a0931f8622ce38c7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:47.287366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:47.287948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a23786597854812a0931f8622ce38c7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:47.288092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:47.288271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:47.288541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] PATH_INFO: `/v3/projects/43ffa94584a04ce1a6a8e2542440658e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:47.289835 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ffa94584a04ce1a6a8e2542440658e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:47.289965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:47.292672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:47.306567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:47.335234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:47.354559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a23786597854812a0931f8622ce38c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.367644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ffa94584a04ce1a6a8e2542440658e', 'request_id': 'req-c9d951f6-8d16-4775-bc97-6b151153eb27'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.367857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a23786597854812a0931f8622ce38c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.368563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a23786597854812a0931f8622ce38c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.375208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ffa94584a04ce1a6a8e2542440658e', 'request_id': 'req-c9d951f6-8d16-4775-bc97-6b151153eb27'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.378964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a23786597854812a0931f8622ce38c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.380256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a23786597854812a0931f8622ce38c7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.382672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ffa94584a04ce1a6a8e2542440658e', 'request_id': 'req-c9d951f6-8d16-4775-bc97-6b151153eb27'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.397542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 907/1804] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:47 2022] DELETE /identity/v3/users/4a23786597854812a0931f8622ce38c7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:47.398205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] The token cache is being invalidate because project 43ffa94584a04ce1a6a8e2542440658e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:47.398533 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.399201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.401795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 898/1805] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:47 2022] DELETE /identity/v3/projects/43ffa94584a04ce1a6a8e2542440658e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:47.405466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:47.407398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:47.439820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:47.441629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:47.483645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3a758-f462-4a7e-be84-211eb6c2c0a5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:47.488912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:47.489614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:47.489963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:47.490239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] PATH_INFO: `/v3/users/3afe9831def4429d99dbbe599c75e7e9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:47.491428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afe9831def4429d99dbbe599c75e7e9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:47.494704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:47.541047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d951f6-8d16-4775-bc97-6b151153eb27 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:47.547062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:47.547712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:47.548009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:47.548299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] PATH_INFO: `/v3/users/18caa79810744c4a9d16c2044ff1f9a1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:47.549516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=18caa79810744c4a9d16c2044ff1f9a1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:47.551439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:47.559067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afe9831def4429d99dbbe599c75e7e9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.574196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afe9831def4429d99dbbe599c75e7e9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.574960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afe9831def4429d99dbbe599c75e7e9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.584732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afe9831def4429d99dbbe599c75e7e9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.585585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0e11118b-7de6-428f-8e5b-41a27b72857e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afe9831def4429d99dbbe599c75e7e9'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.600768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 908/1806] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:47 2022] DELETE /identity/v3/users/3afe9831def4429d99dbbe599c75e7e9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:47.608042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18caa79810744c4a9d16c2044ff1f9a1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.628650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18caa79810744c4a9d16c2044ff1f9a1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.629523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18caa79810744c4a9d16c2044ff1f9a1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.640700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18caa79810744c4a9d16c2044ff1f9a1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.641637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18caa79810744c4a9d16c2044ff1f9a1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.661913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 899/1807] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:47 2022] DELETE /identity/v3/users/18caa79810744c4a9d16c2044ff1f9a1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:47.666676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9536e-526d-419c-be1e-efc11b7eab01 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:47.667210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9536e-526d-419c-be1e-efc11b7eab01 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:47.667311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9536e-526d-419c-be1e-efc11b7eab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:47.710319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-23e9536e-526d-419c-be1e-efc11b7eab01 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:47.711770 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-23e9536e-526d-419c-be1e-efc11b7eab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:47.752759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:47.828136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 909/1808] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:47.831309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:47.832578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:47.854776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9536e-526d-419c-be1e-efc11b7eab01 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:47.858638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-23e9536e-526d-419c-be1e-efc11b7eab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:47.882606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24dd0-e5e5-43b5-8281-e3bd73406dcf admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:47.892289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:47.892970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:47.893251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:47.893600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] PATH_INFO: `/v3/projects/758ac8ee488d498882fce45dc7255676` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:47.895983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758ac8ee488d498882fce45dc7255676)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:47.898719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:47.923019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:47.935242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9536e-526d-419c-be1e-efc11b7eab01 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:47.940653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbdf34-64df-406a-b280-48d18a95b306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:47.941603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbdf34-64df-406a-b280-48d18a95b306 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:47.941933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbdf34-64df-406a-b280-48d18a95b306 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:47.942248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbdf34-64df-406a-b280-48d18a95b306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:47.956440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbdf34-64df-406a-b280-48d18a95b306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:47.958588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbdf34-64df-406a-b280-48d18a95b306 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:47.970629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 910/1809] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:47.973083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758ac8ee488d498882fce45dc7255676', 'request_id': 'req-a79500d9-3224-4ab0-978d-14c29aa65692'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.989336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758ac8ee488d498882fce45dc7255676', 'request_id': 'req-a79500d9-3224-4ab0-978d-14c29aa65692'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:47.998292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758ac8ee488d498882fce45dc7255676', 'request_id': 'req-a79500d9-3224-4ab0-978d-14c29aa65692'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.027086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] The token cache is being invalidate because project 758ac8ee488d498882fce45dc7255676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:48.027526 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.028328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.034056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 900/1810] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:47 2022] DELETE /identity/v3/projects/758ac8ee488d498882fce45dc7255676 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:48.036523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14faa3e-3c16-49bc-a3cb-06c477aa5ec4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.036879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14faa3e-3c16-49bc-a3cb-06c477aa5ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.037259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14faa3e-3c16-49bc-a3cb-06c477aa5ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.060007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b14faa3e-3c16-49bc-a3cb-06c477aa5ec4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:48.061303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b14faa3e-3c16-49bc-a3cb-06c477aa5ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.066673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.068029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.166649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 911/1811] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:48.174298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81759-dde1-42ad-a8c1-cc5a6e6e055a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.174506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81759-dde1-42ad-a8c1-cc5a6e6e055a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.174801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81759-dde1-42ad-a8c1-cc5a6e6e055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.188053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79500d9-3224-4ab0-978d-14c29aa65692 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.199477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.200192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.200780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.201068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] PATH_INFO: `/v3/projects/1b8775df79d8489d8590ef71923b6eff` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.202294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8775df79d8489d8590ef71923b6eff)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.204270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.205264 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-08d81759-dde1-42ad-a8c1-cc5a6e6e055a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:48.206885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-08d81759-dde1-42ad-a8c1-cc5a6e6e055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.217637 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 912/1812] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:48.219160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81759-dde1-42ad-a8c1-cc5a6e6e055a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.229323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81759-dde1-42ad-a8c1-cc5a6e6e055a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.235301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.235902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.236267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.236437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.237084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:48.237386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.239028 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.255936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 913/1813] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:00:48.256939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.264327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8775df79d8489d8590ef71923b6eff', 'request_id': 'req-4dbb1a04-2562-4b73-8d27-319d7b9e8767'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.269917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c721c-9643-4354-92e5-06ddee3fa2e7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.280614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8775df79d8489d8590ef71923b6eff', 'request_id': 'req-4dbb1a04-2562-4b73-8d27-319d7b9e8767'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.287110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8775df79d8489d8590ef71923b6eff', 'request_id': 'req-4dbb1a04-2562-4b73-8d27-319d7b9e8767'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.303009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] The token cache is being invalidate because project 1b8775df79d8489d8590ef71923b6eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:48.303385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.304272 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4dbb1a04-2562-4b73-8d27-319d7b9e8767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.306249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 901/1814] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:48 2022] DELETE /identity/v3/projects/1b8775df79d8489d8590ef71923b6eff => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:48.311667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f5f4-b870-4a9d-a96f-90867b729a3f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.312179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f5f4-b870-4a9d-a96f-90867b729a3f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.312508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287f5f4-b870-4a9d-a96f-90867b729a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.334178 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:48.336361 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d287f5f4-b870-4a9d-a96f-90867b729a3f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:48.338311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d287f5f4-b870-4a9d-a96f-90867b729a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.347896 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.348716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.349560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.349734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.350524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.352969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.378331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:48.387846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 914/1815] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:48.387846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.388586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.425567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 902/1816] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:48.425567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287f5f4-b870-4a9d-a96f-90867b729a3f None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.425567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d287f5f4-b870-4a9d-a96f-90867b729a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.434161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287f5f4-b870-4a9d-a96f-90867b729a3f None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.460946 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666314-445c-417c-923a-0c3fe39936db admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.467124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.468907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.469259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.469682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] PATH_INFO: `/v3/projects/c47ab7457f21424dbda3a8522819ac6a` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.472109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47ab7457f21424dbda3a8522819ac6a)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.475096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.496703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dce05b-7dcd-4c3f-aef3-9e809f941190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.497315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dce05b-7dcd-4c3f-aef3-9e809f941190 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.497628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dce05b-7dcd-4c3f-aef3-9e809f941190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.497902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dce05b-7dcd-4c3f-aef3-9e809f941190 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.498548 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dce05b-7dcd-4c3f-aef3-9e809f941190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.500452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dce05b-7dcd-4c3f-aef3-9e809f941190 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.524185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 903/1817] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:48.525839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47ab7457f21424dbda3a8522819ac6a', 'request_id': 'req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.525983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c755e9-8230-4b38-bf04-338d2927f763 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.526252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c755e9-8230-4b38-bf04-338d2927f763 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.526522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c755e9-8230-4b38-bf04-338d2927f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.532268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47ab7457f21424dbda3a8522819ac6a', 'request_id': 'req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.539249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47ab7457f21424dbda3a8522819ac6a', 'request_id': 'req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.546428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-94c755e9-8230-4b38-bf04-338d2927f763 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:48.547749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-94c755e9-8230-4b38-bf04-338d2927f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.552624 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] The token cache is being invalidate because project c47ab7457f21424dbda3a8522819ac6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:48.553024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.554171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.555856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 915/1818] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:48 2022] DELETE /identity/v3/projects/c47ab7457f21424dbda3a8522819ac6a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:48.556710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.558112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.615598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 904/1819] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:48.619264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c755e9-8230-4b38-bf04-338d2927f763 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.620323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-94c755e9-8230-4b38-bf04-338d2927f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.626627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464bdb2-0b00-4151-82eb-ea1ba8eb616a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.631720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c755e9-8230-4b38-bf04-338d2927f763 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.631864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d0d24-a302-4c81-83ea-e9faae98e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.632992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d0d24-a302-4c81-83ea-e9faae98e11c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.633269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d0d24-a302-4c81-83ea-e9faae98e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.633565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d0d24-a302-4c81-83ea-e9faae98e11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.634308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d0d24-a302-4c81-83ea-e9faae98e11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.635906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d0d24-a302-4c81-83ea-e9faae98e11c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.636378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.636985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.637259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.637563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] PATH_INFO: `/v3/users/f7772f3f15c74c75b16ce6500285352f` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.638816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7772f3f15c74c75b16ce6500285352f)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.640622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.646164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 916/1820] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:48.650403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d0d24-a302-4c81-83ea-e9faae98e11c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.655159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:48.661630 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d0d24-a302-4c81-83ea-e9faae98e11c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.668334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53400690-94e2-4187-812b-825e54341842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.668961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53400690-94e2-4187-812b-825e54341842 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.669212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53400690-94e2-4187-812b-825e54341842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.669470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53400690-94e2-4187-812b-825e54341842 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.670125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53400690-94e2-4187-812b-825e54341842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:48.670464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53400690-94e2-4187-812b-825e54341842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.672299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53400690-94e2-4187-812b-825e54341842 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.685696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 917/1821] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:48.686357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53400690-94e2-4187-812b-825e54341842 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.693550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7772f3f15c74c75b16ce6500285352f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.696964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53400690-94e2-4187-812b-825e54341842 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.699521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:48.702192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.702799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.703077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.703658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.704111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.705705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.712786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7772f3f15c74c75b16ce6500285352f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.713862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7772f3f15c74c75b16ce6500285352f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.720570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 918/1822] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:48.720570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.720570 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.725244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7772f3f15c74c75b16ce6500285352f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.725901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7772f3f15c74c75b16ce6500285352f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:48.734034 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce4538-fa4f-4bea-8109-ade028b81190 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.739780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5eeb-d21e-4954-9d3d-6470a6b82fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.739956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 905/1823] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:48 2022] DELETE /identity/v3/users/f7772f3f15c74c75b16ce6500285352f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:48.740385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5eeb-d21e-4954-9d3d-6470a6b82fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.740670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5eeb-d21e-4954-9d3d-6470a6b82fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.740788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.740945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5eeb-d21e-4954-9d3d-6470a6b82fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.741645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5eeb-d21e-4954-9d3d-6470a6b82fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.742420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.746748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5eeb-d21e-4954-9d3d-6470a6b82fe0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.775707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 919/1824] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:48.780357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5eeb-d21e-4954-9d3d-6470a6b82fe0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.831362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e29dc3-03af-4979-b01a-288af8a6713f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.860774 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5eeb-d21e-4954-9d3d-6470a6b82fe0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.865915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153759b-56d3-4163-9aa2-7bca7d644cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.866528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153759b-56d3-4163-9aa2-7bca7d644cac admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.866809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153759b-56d3-4163-9aa2-7bca7d644cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.867070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153759b-56d3-4163-9aa2-7bca7d644cac admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.867699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153759b-56d3-4163-9aa2-7bca7d644cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.869745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153759b-56d3-4163-9aa2-7bca7d644cac admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.897447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ace18-63ee-4a52-aec2-44ca8d2f90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.898340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ace18-63ee-4a52-aec2-44ca8d2f90de admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.898629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ace18-63ee-4a52-aec2-44ca8d2f90de admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.898907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ace18-63ee-4a52-aec2-44ca8d2f90de admin admin] PATH_INFO: `/v3/projects/5d716a28995942e788205c1ad1e83bb3/users/26a54235fb424dfd825b2de9f7aaa006/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.900635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 920/1825] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:48.914440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153759b-56d3-4163-9aa2-7bca7d644cac admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.917447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ace18-63ee-4a52-aec2-44ca8d2f90de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d716a28995942e788205c1ad1e83bb3, user_id=26a54235fb424dfd825b2de9f7aaa006, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.920432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ace18-63ee-4a52-aec2-44ca8d2f90de admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.927461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153759b-56d3-4163-9aa2-7bca7d644cac admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.933110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff913-fde5-4a27-a349-11d960904b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.933857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff913-fde5-4a27-a349-11d960904b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.934154 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff913-fde5-4a27-a349-11d960904b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.934522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff913-fde5-4a27-a349-11d960904b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.935203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ff913-fde5-4a27-a349-11d960904b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.936881 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ff913-fde5-4a27-a349-11d960904b23 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.938466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 906/1826] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:48 2022] PUT /identity/v3/projects/5d716a28995942e788205c1ad1e83bb3/users/26a54235fb424dfd825b2de9f7aaa006/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:48.943328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154e2d-c9e6-4b3f-b03b-9085503229d1 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.943618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154e2d-c9e6-4b3f-b03b-9085503229d1 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.943889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8154e2d-c9e6-4b3f-b03b-9085503229d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.960784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 921/1827] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:48.965434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff913-fde5-4a27-a349-11d960904b23 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.967771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a8154e2d-c9e6-4b3f-b03b-9085503229d1 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:48.968992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a8154e2d-c9e6-4b3f-b03b-9085503229d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.977344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff913-fde5-4a27-a349-11d960904b23 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.064127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 907/1828] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.066262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8154e2d-c9e6-4b3f-b03b-9085503229d1 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.067816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a8154e2d-c9e6-4b3f-b03b-9085503229d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.069380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.070044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.070317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.070588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.071236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.072990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.075795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:49.081615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8154e2d-c9e6-4b3f-b03b-9085503229d1 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.086489 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 922/1829] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:49.089100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.092735 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.094063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.095012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.095366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.095709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] PATH_INFO: `/v3/projects/ce05c80624b748e5aa4236a63b4dff50` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.097575 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce05c80624b748e5aa4236a63b4dff50)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.099578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.140260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:49.170680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce05c80624b748e5aa4236a63b4dff50', 'request_id': 'req-c4374d1e-f448-40da-a8b0-667f5e4afa76'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:49.178324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce05c80624b748e5aa4236a63b4dff50', 'request_id': 'req-c4374d1e-f448-40da-a8b0-667f5e4afa76'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:49.178490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e3c1-fb74-4580-bea4-cd0ccf7d34a5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.186725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce05c80624b748e5aa4236a63b4dff50', 'request_id': 'req-c4374d1e-f448-40da-a8b0-667f5e4afa76'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:49.212261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] The token cache is being invalidate because project ce05c80624b748e5aa4236a63b4dff50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:49.213151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:49.213919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:49.218658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 908/1830] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:49 2022] DELETE /identity/v3/projects/ce05c80624b748e5aa4236a63b4dff50 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:49.218658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.219187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.248198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d48dd-d844-464b-add7-c3f97a50e17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.248930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d48dd-d844-464b-add7-c3f97a50e17f service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.249228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d48dd-d844-464b-add7-c3f97a50e17f service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.249597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d48dd-d844-464b-add7-c3f97a50e17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.253425 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-638d48dd-d844-464b-add7-c3f97a50e17f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.305519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374d1e-f448-40da-a8b0-667f5e4afa76 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.310737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95223ea-eab5-42a0-8a5e-5c103740e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.311396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95223ea-eab5-42a0-8a5e-5c103740e0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.311704 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95223ea-eab5-42a0-8a5e-5c103740e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.311983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95223ea-eab5-42a0-8a5e-5c103740e0d7 admin admin] PATH_INFO: `/v3/projects/b1292246ff0e466abc9f0530f0396a96/users/c9a11988427145cfa7fdce623e0ddb61/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.327853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95223ea-eab5-42a0-8a5e-5c103740e0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1292246ff0e466abc9f0530f0396a96, user_id=c9a11988427145cfa7fdce623e0ddb61, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.328966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d48dd-d844-464b-add7-c3f97a50e17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.330445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d48dd-d844-464b-add7-c3f97a50e17f service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.331014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95223ea-eab5-42a0-8a5e-5c103740e0d7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.341268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 923/1831] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:49.342882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0563b-c3c1-48f5-beac-f022cc119303 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.343173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0563b-c3c1-48f5-beac-f022cc119303 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.343452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0563b-c3c1-48f5-beac-f022cc119303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.348584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 909/1832] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:49 2022] PUT /identity/v3/projects/b1292246ff0e466abc9f0530f0396a96/users/c9a11988427145cfa7fdce623e0ddb61/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:49.350257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b05d-e908-4eca-95b4-9f9798b6cc05 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.350957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b05d-e908-4eca-95b4-9f9798b6cc05 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.351301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b05d-e908-4eca-95b4-9f9798b6cc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.372789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-42c0563b-c3c1-48f5-beac-f022cc119303 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.374187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-42c0563b-c3c1-48f5-beac-f022cc119303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.376783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-1c04b05d-e908-4eca-95b4-9f9798b6cc05 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.377989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1c04b05d-e908-4eca-95b4-9f9798b6cc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.445376 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 910/1833] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.446039 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 924/1834] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.456594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c5d9-f6fb-4eea-bf0f-7580da134983 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.456888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c5d9-f6fb-4eea-bf0f-7580da134983 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.457166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0c5d9-f6fb-4eea-bf0f-7580da134983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.461201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0563b-c3c1-48f5-beac-f022cc119303 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.463549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-42c0563b-c3c1-48f5-beac-f022cc119303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.479791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f5c0c5d9-f6fb-4eea-bf0f-7580da134983 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.481247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f5c0c5d9-f6fb-4eea-bf0f-7580da134983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.491732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 911/1835] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.495703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0c5d9-f6fb-4eea-bf0f-7580da134983 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.500879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:49.512911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0c5d9-f6fb-4eea-bf0f-7580da134983 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.517467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:49.520573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.521175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.522168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.522518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.524484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:49.525499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.527465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.535908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0563b-c3c1-48f5-beac-f022cc119303 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.539942 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb112f8-5098-4716-a9e6-d3dbe0143ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.540960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb112f8-5098-4716-a9e6-d3dbe0143ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.541120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 912/1836] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:00:49.541210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb112f8-5098-4716-a9e6-d3dbe0143ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.541371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb112f8-5098-4716-a9e6-d3dbe0143ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.545277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.560356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb112f8-5098-4716-a9e6-d3dbe0143ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.563470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb112f8-5098-4716-a9e6-d3dbe0143ec7 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.567347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2829bb-7104-4f0a-b581-87b74efd97f4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.574891 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb560f-3277-4bc2-98b2-d649417f1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.575523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb560f-3277-4bc2-98b2-d649417f1655 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.575807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb560f-3277-4bc2-98b2-d649417f1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.576087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb560f-3277-4bc2-98b2-d649417f1655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.576733 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb560f-3277-4bc2-98b2-d649417f1655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.578701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb560f-3277-4bc2-98b2-d649417f1655 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.579283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 925/1837] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:49.618936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 913/1838] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:49.620376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb112f8-5098-4716-a9e6-d3dbe0143ec7 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.631978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb112f8-5098-4716-a9e6-d3dbe0143ec7 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.719396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561c0fe-f6e5-4292-97b7-f9b2cf83c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.720140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c0fe-f6e5-4292-97b7-f9b2cf83c769 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.720478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c0fe-f6e5-4292-97b7-f9b2cf83c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.721269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c0fe-f6e5-4292-97b7-f9b2cf83c769 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.722048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561c0fe-f6e5-4292-97b7-f9b2cf83c769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.725318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561c0fe-f6e5-4292-97b7-f9b2cf83c769 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.766039 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 926/1839] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:49.770278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb560f-3277-4bc2-98b2-d649417f1655 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.798707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb560f-3277-4bc2-98b2-d649417f1655 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.808023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cc7b6-3fb1-42de-877a-5a411e786595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.808819 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc7b6-3fb1-42de-877a-5a411e786595 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.809792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc7b6-3fb1-42de-877a-5a411e786595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.810171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc7b6-3fb1-42de-877a-5a411e786595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.810961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cc7b6-3fb1-42de-877a-5a411e786595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.812797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cc7b6-3fb1-42de-877a-5a411e786595 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.830620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 914/1840] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:49.835797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561c0fe-f6e5-4292-97b7-f9b2cf83c769 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.849858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561c0fe-f6e5-4292-97b7-f9b2cf83c769 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.854932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819b29-3b48-4613-94d1-8256d3c13571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.855550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819b29-3b48-4613-94d1-8256d3c13571 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.855849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819b29-3b48-4613-94d1-8256d3c13571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.856104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819b29-3b48-4613-94d1-8256d3c13571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.856754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819b29-3b48-4613-94d1-8256d3c13571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.858510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819b29-3b48-4613-94d1-8256d3c13571 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.871669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 927/1841] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:49.875746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cc7b6-3fb1-42de-877a-5a411e786595 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.889640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cc7b6-3fb1-42de-877a-5a411e786595 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.894458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.895125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.895465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.895746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] PATH_INFO: `/v3/projects/7cdd3e2f2a314a5f9081b04ac799f719/users/fa777be174ff4ea7918258d60ea3477b/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.926124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdd3e2f2a314a5f9081b04ac799f719, user_id=fa777be174ff4ea7918258d60ea3477b, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.929695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.945531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 915/1842] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:49 2022] PUT /identity/v3/projects/7cdd3e2f2a314a5f9081b04ac799f719/users/fa777be174ff4ea7918258d60ea3477b/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:49.956840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c4ba-8597-40d6-9398-d28dbec217b8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.957026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c4ba-8597-40d6-9398-d28dbec217b8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.957518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2c4ba-8597-40d6-9398-d28dbec217b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.991973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-26b2c4ba-8597-40d6-9398-d28dbec217b8 None None] MFA Rules not processed for user `fa777be174ff4ea7918258d60ea3477b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.993212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-26b2c4ba-8597-40d6-9398-d28dbec217b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:50.078822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 928/1843] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:50.090175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.091918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:50.163732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb39dd-90ab-4bf7-8be4-a1f2f19d6dc1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.167661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd37ac-f6af-4de0-b813-e62aa75d3311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.168228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd37ac-f6af-4de0-b813-e62aa75d3311 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.168532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd37ac-f6af-4de0-b813-e62aa75d3311 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.168744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd37ac-f6af-4de0-b813-e62aa75d3311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.177455 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd37ac-f6af-4de0-b813-e62aa75d3311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.178897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd37ac-f6af-4de0-b813-e62aa75d3311 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.188779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 916/1844] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:50.241850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2c4ba-8597-40d6-9398-d28dbec217b8 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.314400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:50.344484 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2c4ba-8597-40d6-9398-d28dbec217b8 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.353825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.355382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.355973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.356452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] PATH_INFO: `/v3/users/fa777be174ff4ea7918258d60ea3477b` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.358855 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa777be174ff4ea7918258d60ea3477b)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.363374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.435573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa777be174ff4ea7918258d60ea3477b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:50.451424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa777be174ff4ea7918258d60ea3477b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:50.452185 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa777be174ff4ea7918258d60ea3477b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:50.464536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa777be174ff4ea7918258d60ea3477b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:50.465368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-61305f24-1b08-43a5-b2cf-09d7bb73bb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa777be174ff4ea7918258d60ea3477b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:50.493110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 929/1845] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:50 2022] DELETE /identity/v3/users/fa777be174ff4ea7918258d60ea3477b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:50.495543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709fbe-1275-4e46-900a-7e41190ca311 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.496027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709fbe-1275-4e46-900a-7e41190ca311 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.496136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709fbe-1275-4e46-900a-7e41190ca311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.520817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ed709fbe-1275-4e46-900a-7e41190ca311 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:50.522175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ed709fbe-1275-4e46-900a-7e41190ca311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:50.593659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f3ed-d351-498c-8139-c277ce23dccd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.593944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f3ed-d351-498c-8139-c277ce23dccd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.594221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f3ed-d351-498c-8139-c277ce23dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.634428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 917/1846] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:50.646390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b563f3ed-d351-498c-8139-c277ce23dccd None None] MFA Rules not processed for user `c9a11988427145cfa7fdce623e0ddb61`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:50.648542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b563f3ed-d351-498c-8139-c277ce23dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:50.682048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed709fbe-1275-4e46-900a-7e41190ca311 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.683573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ed709fbe-1275-4e46-900a-7e41190ca311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:50.741603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 930/1847] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:50.742864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563f3ed-d351-498c-8139-c277ce23dccd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.744473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b563f3ed-d351-498c-8139-c277ce23dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:50.772116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563f3ed-d351-498c-8139-c277ce23dccd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.775475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:50.788016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665dc31-7a31-495d-b6a1-7d4e29fab4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.788016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665dc31-7a31-495d-b6a1-7d4e29fab4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.788016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665dc31-7a31-495d-b6a1-7d4e29fab4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.788379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665dc31-7a31-495d-b6a1-7d4e29fab4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.789068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665dc31-7a31-495d-b6a1-7d4e29fab4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.791800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665dc31-7a31-495d-b6a1-7d4e29fab4c4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.803397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed709fbe-1275-4e46-900a-7e41190ca311 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.808586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620a5d0-f770-4c1c-94c5-b451bb2f5b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.809514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620a5d0-f770-4c1c-94c5-b451bb2f5b47 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.810144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620a5d0-f770-4c1c-94c5-b451bb2f5b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.810619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620a5d0-f770-4c1c-94c5-b451bb2f5b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.821256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620a5d0-f770-4c1c-94c5-b451bb2f5b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.823125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620a5d0-f770-4c1c-94c5-b451bb2f5b47 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.835131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 918/1848] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:50.838634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 931/1849] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:00:50.843103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620a5d0-f770-4c1c-94c5-b451bb2f5b47 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.853772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620a5d0-f770-4c1c-94c5-b451bb2f5b47 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.936517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709caa9f-23e1-44cf-9fc5-97b494ee83d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.937144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709caa9f-23e1-44cf-9fc5-97b494ee83d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.937519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709caa9f-23e1-44cf-9fc5-97b494ee83d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.938021 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709caa9f-23e1-44cf-9fc5-97b494ee83d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.939555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709caa9f-23e1-44cf-9fc5-97b494ee83d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.940939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709caa9f-23e1-44cf-9fc5-97b494ee83d1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.972567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 919/1850] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.977135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665dc31-7a31-495d-b6a1-7d4e29fab4c4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.001501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665dc31-7a31-495d-b6a1-7d4e29fab4c4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.006856 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5733c92-aef1-43a4-8176-2dd59f0d4f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.007626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733c92-aef1-43a4-8176-2dd59f0d4f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.008005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733c92-aef1-43a4-8176-2dd59f0d4f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.008466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5733c92-aef1-43a4-8176-2dd59f0d4f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.009918 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5733c92-aef1-43a4-8176-2dd59f0d4f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.011883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5733c92-aef1-43a4-8176-2dd59f0d4f08 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.030668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 932/1851] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:51.037535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709caa9f-23e1-44cf-9fc5-97b494ee83d1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.053113 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709caa9f-23e1-44cf-9fc5-97b494ee83d1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.059631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac296e58-c580-4997-8c11-9a958b3b1c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.060628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac296e58-c580-4997-8c11-9a958b3b1c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.061098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac296e58-c580-4997-8c11-9a958b3b1c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.061616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac296e58-c580-4997-8c11-9a958b3b1c7a admin admin] PATH_INFO: `/v3/projects/b7cde5ae43f440a9b12acda095dd1666/users/50f91df7a2794bcaba30ee0dd99793b1/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.089268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac296e58-c580-4997-8c11-9a958b3b1c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7cde5ae43f440a9b12acda095dd1666, user_id=50f91df7a2794bcaba30ee0dd99793b1, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.092579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac296e58-c580-4997-8c11-9a958b3b1c7a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.110847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 920/1852] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:51 2022] PUT /identity/v3/projects/b7cde5ae43f440a9b12acda095dd1666/users/50f91df7a2794bcaba30ee0dd99793b1/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:51.115028 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5733c92-aef1-43a4-8176-2dd59f0d4f08 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.129703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5733c92-aef1-43a4-8176-2dd59f0d4f08 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.159689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:51.254478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.255397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.255687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.255960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.256672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.258361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.271419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 933/1853] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:51.276079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac296e58-c580-4997-8c11-9a958b3b1c7a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.292673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac296e58-c580-4997-8c11-9a958b3b1c7a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.304458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414736e-f3a8-446e-a3e5-83b8c5689df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.307006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414736e-f3a8-446e-a3e5-83b8c5689df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.309189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414736e-f3a8-446e-a3e5-83b8c5689df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.309926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414736e-f3a8-446e-a3e5-83b8c5689df7 admin admin] PATH_INFO: `/v3/projects/b7cde5ae43f440a9b12acda095dd1666/users/50f91df7a2794bcaba30ee0dd99793b1/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.313403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414736e-f3a8-446e-a3e5-83b8c5689df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7cde5ae43f440a9b12acda095dd1666, user_id=50f91df7a2794bcaba30ee0dd99793b1, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.318288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414736e-f3a8-446e-a3e5-83b8c5689df7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.361214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 921/1854] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:51 2022] PUT /identity/v3/projects/b7cde5ae43f440a9b12acda095dd1666/users/50f91df7a2794bcaba30ee0dd99793b1/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:51.460517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.463076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.478852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f476072-3b5e-4ae0-bcf5-aa043cf53b13 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.611295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.613339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.614412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.614736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] PATH_INFO: `/v3/projects/7cdd3e2f2a314a5f9081b04ac799f719` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.616564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cdd3e2f2a314a5f9081b04ac799f719)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.622941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.726607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdd3e2f2a314a5f9081b04ac799f719', 'request_id': 'req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:51.741153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdd3e2f2a314a5f9081b04ac799f719', 'request_id': 'req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:51.753971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdd3e2f2a314a5f9081b04ac799f719', 'request_id': 'req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:51.798970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] The token cache is being invalidate because project 7cdd3e2f2a314a5f9081b04ac799f719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:51.798970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:51.799702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ed82233a-c0e2-4c16-9db2-1549aa2b32a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:51.801556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 934/1855] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:51 2022] DELETE /identity/v3/projects/7cdd3e2f2a314a5f9081b04ac799f719 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:51.806428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8f169-0364-487b-8409-a6478e190a13 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.806901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8f169-0364-487b-8409-a6478e190a13 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.807088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8f169-0364-487b-8409-a6478e190a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.847477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-79f8f169-0364-487b-8409-a6478e190a13 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.848738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-79f8f169-0364-487b-8409-a6478e190a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.974729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 922/1856] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.983177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f22b0-fb96-4943-90b9-a7aeee6a9973 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.983526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f22b0-fb96-4943-90b9-a7aeee6a9973 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.983715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f22b0-fb96-4943-90b9-a7aeee6a9973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.017329 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-703f22b0-fb96-4943-90b9-a7aeee6a9973 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:52.018685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-703f22b0-fb96-4943-90b9-a7aeee6a9973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:52.028222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 935/1857] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:52.032616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8f169-0364-487b-8409-a6478e190a13 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.044087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8f169-0364-487b-8409-a6478e190a13 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.051249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.052650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.052977 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.053260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.054068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:52.054662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.057795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.079839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f22b0-fb96-4943-90b9-a7aeee6a9973 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.082668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 923/1858] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:52.109033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f22b0-fb96-4943-90b9-a7aeee6a9973 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.135612 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f078e02-5e7f-48ad-8b7f-ec5ab9b07395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.136271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f078e02-5e7f-48ad-8b7f-ec5ab9b07395 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.136576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f078e02-5e7f-48ad-8b7f-ec5ab9b07395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.137303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f078e02-5e7f-48ad-8b7f-ec5ab9b07395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.137517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f078e02-5e7f-48ad-8b7f-ec5ab9b07395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.144936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f078e02-5e7f-48ad-8b7f-ec5ab9b07395 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.208295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 936/1859] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:52 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:52.209763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.221843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de366c68-33bf-48c9-9093-10c80be7fc9b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.257636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:52.341111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca553c-d3b8-4c3f-a67c-85921b477080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.342050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca553c-d3b8-4c3f-a67c-85921b477080 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.342253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca553c-d3b8-4c3f-a67c-85921b477080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.342515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca553c-d3b8-4c3f-a67c-85921b477080 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.343171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca553c-d3b8-4c3f-a67c-85921b477080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.345992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca553c-d3b8-4c3f-a67c-85921b477080 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.377931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 924/1860] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:52 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:52.381641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f078e02-5e7f-48ad-8b7f-ec5ab9b07395 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.393823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f078e02-5e7f-48ad-8b7f-ec5ab9b07395 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.401836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed0af7-a2ee-49fb-b55c-864b468ca060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.402469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0af7-a2ee-49fb-b55c-864b468ca060 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.402747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0af7-a2ee-49fb-b55c-864b468ca060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.403020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0af7-a2ee-49fb-b55c-864b468ca060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.403666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed0af7-a2ee-49fb-b55c-864b468ca060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.408689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed0af7-a2ee-49fb-b55c-864b468ca060 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.441468 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 937/1861] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:52.447436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca553c-d3b8-4c3f-a67c-85921b477080 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.458984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca553c-d3b8-4c3f-a67c-85921b477080 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.464114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041ef8b-dc38-4778-8976-cb48aa467616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.464851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ef8b-dc38-4778-8976-cb48aa467616 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.465003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ef8b-dc38-4778-8976-cb48aa467616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.465271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ef8b-dc38-4778-8976-cb48aa467616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.466266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041ef8b-dc38-4778-8976-cb48aa467616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.467600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041ef8b-dc38-4778-8976-cb48aa467616 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.485992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed0af7-a2ee-49fb-b55c-864b468ca060 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.486427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 925/1862] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:52.497037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed0af7-a2ee-49fb-b55c-864b468ca060 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.508608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23bb44-931c-4342-b339-0439bb10f96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.509917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23bb44-931c-4342-b339-0439bb10f96b admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.510676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23bb44-931c-4342-b339-0439bb10f96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.510959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23bb44-931c-4342-b339-0439bb10f96b admin admin] PATH_INFO: `/v3/projects/4e7545597f9d4bff83b0a57971f599a9/users/f04615c15e504b36a79c5c589e93c359/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.522510 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:52.534623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0828c-2a2e-4fdf-9b6c-942b71a714e0 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.535405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0828c-2a2e-4fdf-9b6c-942b71a714e0 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.535769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0828c-2a2e-4fdf-9b6c-942b71a714e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.550157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23bb44-931c-4342-b339-0439bb10f96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7545597f9d4bff83b0a57971f599a9, user_id=f04615c15e504b36a79c5c589e93c359, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.556608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23bb44-931c-4342-b339-0439bb10f96b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.581532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 938/1863] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:52 2022] PUT /identity/v3/projects/4e7545597f9d4bff83b0a57971f599a9/users/f04615c15e504b36a79c5c589e93c359/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:52.594216 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf4f1-5a91-4c79-b12a-b38722179580 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.594506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf4f1-5a91-4c79-b12a-b38722179580 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.596906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf4f1-5a91-4c79-b12a-b38722179580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.607787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-bdf0828c-2a2e-4fdf-9b6c-942b71a714e0 None None] MFA Rules not processed for user `50f91df7a2794bcaba30ee0dd99793b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:52.610118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bdf0828c-2a2e-4fdf-9b6c-942b71a714e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:52.663081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3fddf4f1-5a91-4c79-b12a-b38722179580 None None] MFA Rules not processed for user `f04615c15e504b36a79c5c589e93c359`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:52.665911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3fddf4f1-5a91-4c79-b12a-b38722179580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:52.712812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 926/1864] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:52.724642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0828c-2a2e-4fdf-9b6c-942b71a714e0 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.726064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bdf0828c-2a2e-4fdf-9b6c-942b71a714e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:52.814516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 939/1865] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:52.824154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0828c-2a2e-4fdf-9b6c-942b71a714e0 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.829011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf4f1-5a91-4c79-b12a-b38722179580 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.830583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3fddf4f1-5a91-4c79-b12a-b38722179580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:52.835028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.835657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.836194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.836472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.839460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:52.889940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:52.951145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.953384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.968240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf4f1-5a91-4c79-b12a-b38722179580 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.972305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c51e0-f0c9-475a-84f9-a9a24d7bc7a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3697284166c042d79d946ef469932562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.972926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c51e0-f0c9-475a-84f9-a9a24d7bc7a1 service glance] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.973201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c51e0-f0c9-475a-84f9-a9a24d7bc7a1 service glance] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.973466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c51e0-f0c9-475a-84f9-a9a24d7bc7a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.982845 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 927/1866] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:53.001004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c51e0-f0c9-475a-84f9-a9a24d7bc7a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:53.002572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c51e0-f0c9-475a-84f9-a9a24d7bc7a1 service glance] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:53.019670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 940/1867] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:54.743305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:54.745447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:54.750057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e79e-b105-4a3e-943f-15a5844d2b49 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:54.750552 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e79e-b105-4a3e-943f-15a5844d2b49 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:54.750645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e79e-b105-4a3e-943f-15a5844d2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:54.758408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212e2e-8746-4a1c-b7b4-d8acc8da3796 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:54.764224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:54.765112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:54.765510 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:54.765902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:54.776150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:54.777757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:54.783657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0d65e79e-b105-4a3e-943f-15a5844d2b49 None None] MFA Rules not processed for user `26a54235fb424dfd825b2de9f7aaa006`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:54.784883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0d65e79e-b105-4a3e-943f-15a5844d2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:54.790207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 928/1868] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:00:54.875107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 941/1869] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:54.889420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:54.890892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:55.000281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1f53-71cb-4d22-a4f5-b1467e6f4c69 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:55.006747 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:55.007481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:55.007682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:55.007955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:55.019892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:55.022688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:55.033756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 929/1870] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:56.833931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9eabc-de73-4368-b23c-5e7849402b4b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:56.834555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9eabc-de73-4368-b23c-5e7849402b4b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:56.834555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9eabc-de73-4368-b23c-5e7849402b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:56.857879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-48e9eabc-de73-4368-b23c-5e7849402b4b None None] MFA Rules not processed for user `26a54235fb424dfd825b2de9f7aaa006`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:56.859475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-48e9eabc-de73-4368-b23c-5e7849402b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:56.870628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 942/1871] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:05.028560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=51 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:06.850282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:11.703061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:11.705349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:11.772776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae27c6-737b-4c21-a783-f387edd08953 service nova] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:11.777811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:11.778437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.778713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.778985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] PATH_INFO: `/v3/users/c9a11988427145cfa7fdce623e0ddb61` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.780114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a11988427145cfa7fdce623e0ddb61)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:11.782057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:11.827146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a11988427145cfa7fdce623e0ddb61'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:11.839399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a11988427145cfa7fdce623e0ddb61'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:11.840055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a11988427145cfa7fdce623e0ddb61'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:11.847124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a11988427145cfa7fdce623e0ddb61'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:11.847748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a11988427145cfa7fdce623e0ddb61'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:11.860401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 930/1872] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:11 2022] DELETE /identity/v3/users/c9a11988427145cfa7fdce623e0ddb61 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:12.030363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9eabc-de73-4368-b23c-5e7849402b4b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.044987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9eabc-de73-4368-b23c-5e7849402b4b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.112407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.113077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.116683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.117070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] PATH_INFO: `/v3/projects/b1292246ff0e466abc9f0530f0396a96` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.119229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1292246ff0e466abc9f0530f0396a96)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.121198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.174330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1292246ff0e466abc9f0530f0396a96', 'request_id': 'req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.181771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1292246ff0e466abc9f0530f0396a96', 'request_id': 'req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.190065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1292246ff0e466abc9f0530f0396a96', 'request_id': 'req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.203737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] The token cache is being invalidate because project b1292246ff0e466abc9f0530f0396a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:12.204300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.204937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.206590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 943/1873] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:12 2022] DELETE /identity/v3/projects/b1292246ff0e466abc9f0530f0396a96 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:12.210677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.212347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:12.226356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197539dc-a793-4541-b134-6dd36ad099b5 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.283015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.283566 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.283841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.284115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] PATH_INFO: `/v3/users/50f91df7a2794bcaba30ee0dd99793b1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.285241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f91df7a2794bcaba30ee0dd99793b1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.287187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.312180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:12.350716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f91df7a2794bcaba30ee0dd99793b1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.368253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f91df7a2794bcaba30ee0dd99793b1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.368975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f91df7a2794bcaba30ee0dd99793b1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.378235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f91df7a2794bcaba30ee0dd99793b1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.378874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-811bb74a-05d8-42b6-baae-cf5e5787083b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f91df7a2794bcaba30ee0dd99793b1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.395930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 931/1874] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:12 2022] DELETE /identity/v3/users/50f91df7a2794bcaba30ee0dd99793b1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:12.582316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.583799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:12.596771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f3b0-0e7e-46f2-b6ec-4fb4642ae431 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.663005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.663941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.663941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.664215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] PATH_INFO: `/v3/projects/b7cde5ae43f440a9b12acda095dd1666` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.665518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7cde5ae43f440a9b12acda095dd1666)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.667416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.712858 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:12.729032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7cde5ae43f440a9b12acda095dd1666', 'request_id': 'req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.734943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7cde5ae43f440a9b12acda095dd1666', 'request_id': 'req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.741565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7cde5ae43f440a9b12acda095dd1666', 'request_id': 'req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.755508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] The token cache is being invalidate because project b7cde5ae43f440a9b12acda095dd1666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:12.755798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.756422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8945a2fd-6b07-4e91-b8bf-9c1f4deaa6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:12.758067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 944/1875] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:12 2022] DELETE /identity/v3/projects/b7cde5ae43f440a9b12acda095dd1666 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:12.763609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca77cc-b4c6-43ea-b6ea-b686a2d877bb None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.764104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca77cc-b4c6-43ea-b6ea-b686a2d877bb None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.764198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca77cc-b4c6-43ea-b6ea-b686a2d877bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.784439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-79ca77cc-b4c6-43ea-b6ea-b686a2d877bb None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:12.785683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-79ca77cc-b4c6-43ea-b6ea-b686a2d877bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:12.843338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 932/1876] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:12.851662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac449d7-2f60-4f2a-8df6-46cef7e3ad78 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.851940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac449d7-2f60-4f2a-8df6-46cef7e3ad78 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.852825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac449d7-2f60-4f2a-8df6-46cef7e3ad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.873692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0ac449d7-2f60-4f2a-8df6-46cef7e3ad78 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:12.874882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0ac449d7-2f60-4f2a-8df6-46cef7e3ad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:12.883079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 945/1877] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:12.887797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca77cc-b4c6-43ea-b6ea-b686a2d877bb None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.898149 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca77cc-b4c6-43ea-b6ea-b686a2d877bb None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.903262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.903914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.904187 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.904458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.905108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:12.905417 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.907033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.922287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 933/1878] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:12.923194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac449d7-2f60-4f2a-8df6-46cef7e3ad78 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.933198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac449d7-2f60-4f2a-8df6-46cef7e3ad78 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.938010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3350f-cde3-4929-a1bf-73c81a049ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.938627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3350f-cde3-4929-a1bf-73c81a049ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.938905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3350f-cde3-4929-a1bf-73c81a049ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.939174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3350f-cde3-4929-a1bf-73c81a049ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.939809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3350f-cde3-4929-a1bf-73c81a049ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.941748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3350f-cde3-4929-a1bf-73c81a049ee8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.969509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 946/1879] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:12 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:12.973393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.985009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d9c4d-7859-4dcd-b205-f55cf74ceedb admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.047200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f844cf-8423-43b2-952c-e0bd6996a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.047797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f844cf-8423-43b2-952c-e0bd6996a1ed admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.048073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f844cf-8423-43b2-952c-e0bd6996a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.048344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f844cf-8423-43b2-952c-e0bd6996a1ed admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.048978 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f844cf-8423-43b2-952c-e0bd6996a1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.050936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f844cf-8423-43b2-952c-e0bd6996a1ed admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.074055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 934/1880] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:12 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:13.077692 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3350f-cde3-4929-a1bf-73c81a049ee8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:13.087967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3350f-cde3-4929-a1bf-73c81a049ee8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.092587 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05b94-5ee0-4d10-b96f-d6d744f5440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.093183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05b94-5ee0-4d10-b96f-d6d744f5440a admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.093538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05b94-5ee0-4d10-b96f-d6d744f5440a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.093771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05b94-5ee0-4d10-b96f-d6d744f5440a admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.094410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05b94-5ee0-4d10-b96f-d6d744f5440a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.096002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05b94-5ee0-4d10-b96f-d6d744f5440a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.105792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 947/1881] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:13.109702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f844cf-8423-43b2-952c-e0bd6996a1ed admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:13.119863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f844cf-8423-43b2-952c-e0bd6996a1ed admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.124370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6fc08-a477-405b-8de9-d8bccc818879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.124957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6fc08-a477-405b-8de9-d8bccc818879 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.125231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6fc08-a477-405b-8de9-d8bccc818879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.125521 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6fc08-a477-405b-8de9-d8bccc818879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.126164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6fc08-a477-405b-8de9-d8bccc818879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.127716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6fc08-a477-405b-8de9-d8bccc818879 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.137903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 935/1882] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:13.141928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05b94-5ee0-4d10-b96f-d6d744f5440a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:13.151776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05b94-5ee0-4d10-b96f-d6d744f5440a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.156429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.157075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.157356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.157663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] PATH_INFO: `/v3/projects/34f038cd00b64b33b03fc031df4ac12c/users/f7e3c1152e34448eb540884452293994/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.172939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f038cd00b64b33b03fc031df4ac12c, user_id=f7e3c1152e34448eb540884452293994, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.175638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.189197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 948/1883] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:13 2022] PUT /identity/v3/projects/34f038cd00b64b33b03fc031df4ac12c/users/f7e3c1152e34448eb540884452293994/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:13.199933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd14c1-b43a-444c-b389-b21c078645b2 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.200287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd14c1-b43a-444c-b389-b21c078645b2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.200588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd14c1-b43a-444c-b389-b21c078645b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.208567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:13.229678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d9bd14c1-b43a-444c-b389-b21c078645b2 None None] MFA Rules not processed for user `f7e3c1152e34448eb540884452293994`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:13.230982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d9bd14c1-b43a-444c-b389-b21c078645b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:13.295100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 936/1884] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:13.306249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:13.307931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:13.365227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ac7f1-9884-4755-a583-db0eb24891b0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.369583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98c97a-c542-46e8-bcb1-b5a33fffa52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.370196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c97a-c542-46e8-bcb1-b5a33fffa52b service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.370499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c97a-c542-46e8-bcb1-b5a33fffa52b service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.370768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98c97a-c542-46e8-bcb1-b5a33fffa52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.379120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98c97a-c542-46e8-bcb1-b5a33fffa52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.380546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98c97a-c542-46e8-bcb1-b5a33fffa52b service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.390098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 949/1885] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:23.292199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=30 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:23.385982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:26.000186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd14c1-b43a-444c-b389-b21c078645b2 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:26.001630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d9bd14c1-b43a-444c-b389-b21c078645b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.064743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd14c1-b43a-444c-b389-b21c078645b2 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:26.069236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:26.069903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.070189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.070460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] PATH_INFO: `/v3/users/f04615c15e504b36a79c5c589e93c359` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.071578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04615c15e504b36a79c5c589e93c359)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:26.073503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:26.120303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04615c15e504b36a79c5c589e93c359'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.132347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04615c15e504b36a79c5c589e93c359'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.133559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04615c15e504b36a79c5c589e93c359'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.140571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04615c15e504b36a79c5c589e93c359'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.141190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04615c15e504b36a79c5c589e93c359'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.153603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 937/1886] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:25 2022] DELETE /identity/v3/users/f04615c15e504b36a79c5c589e93c359 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:26.158169 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03f551-f130-4ce1-9291-15d5ec3a710c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.158638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03f551-f130-4ce1-9291-15d5ec3a710c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.158774 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03f551-f130-4ce1-9291-15d5ec3a710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.177976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0e03f551-f130-4ce1-9291-15d5ec3a710c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:26.179173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0e03f551-f130-4ce1-9291-15d5ec3a710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.237877 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 950/1887] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:26.247597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:26.248996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.305380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e0557-ced0-4075-97d9-80ee6d55e291 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:26.309050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2d477-8475-4477-81f2-ea27ba942019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:26.309683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2d477-8475-4477-81f2-ea27ba942019 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.309960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2d477-8475-4477-81f2-ea27ba942019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.310230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2d477-8475-4477-81f2-ea27ba942019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.319009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2d477-8475-4477-81f2-ea27ba942019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:26.320935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2d477-8475-4477-81f2-ea27ba942019 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:26.330175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 938/1888] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:26.662555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03f551-f130-4ce1-9291-15d5ec3a710c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:26.663963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0e03f551-f130-4ce1-9291-15d5ec3a710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.675750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03f551-f130-4ce1-9291-15d5ec3a710c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:26.681198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:26.681885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.682164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.682437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] PATH_INFO: `/v3/projects/4e7545597f9d4bff83b0a57971f599a9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.683718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7545597f9d4bff83b0a57971f599a9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:26.687522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:26.743073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7545597f9d4bff83b0a57971f599a9', 'request_id': 'req-3816cbec-1b12-4265-a804-e0ffcd292aff'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.748486 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7545597f9d4bff83b0a57971f599a9', 'request_id': 'req-3816cbec-1b12-4265-a804-e0ffcd292aff'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.754825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7545597f9d4bff83b0a57971f599a9', 'request_id': 'req-3816cbec-1b12-4265-a804-e0ffcd292aff'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.767462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] The token cache is being invalidate because project 4e7545597f9d4bff83b0a57971f599a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:26.767748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.768353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3816cbec-1b12-4265-a804-e0ffcd292aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.769866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 951/1889] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:26 2022] DELETE /identity/v3/projects/4e7545597f9d4bff83b0a57971f599a9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:26.775352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113f1a-160c-42d6-8d00-38a421da6a10 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.775641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113f1a-160c-42d6-8d00-38a421da6a10 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.775918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113f1a-160c-42d6-8d00-38a421da6a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.796205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-54113f1a-160c-42d6-8d00-38a421da6a10 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:26.797522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-54113f1a-160c-42d6-8d00-38a421da6a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.815728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:26.860301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 939/1890] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:26.868420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a19d5-f826-468d-9159-6fb89cfd982d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.868702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a19d5-f826-468d-9159-6fb89cfd982d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.868971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a19d5-f826-468d-9159-6fb89cfd982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.888557 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-399a19d5-f826-468d-9159-6fb89cfd982d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:26.889780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-399a19d5-f826-468d-9159-6fb89cfd982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.897401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 952/1891] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:26.901381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113f1a-160c-42d6-8d00-38a421da6a10 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:26.910800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113f1a-160c-42d6-8d00-38a421da6a10 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:26.915341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:26.915933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.916210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.916477 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.917120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:26.917422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:26.919033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:26.930703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 940/1892] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:26.934727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a19d5-f826-468d-9159-6fb89cfd982d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:26.943616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a19d5-f826-468d-9159-6fb89cfd982d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:26.948754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9267f-5f34-4ac9-9cca-6400926c2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:26.949336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9267f-5f34-4ac9-9cca-6400926c2923 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.949641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9267f-5f34-4ac9-9cca-6400926c2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.949911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9267f-5f34-4ac9-9cca-6400926c2923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.950539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9267f-5f34-4ac9-9cca-6400926c2923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:26.952410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9267f-5f34-4ac9-9cca-6400926c2923 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:26.982004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 953/1893] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:26 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:26.983399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:26.994155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d5ec0-629e-4aa3-8f76-bbe4b30d1ef7 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:27.049326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66df806-2742-4db9-869b-835bd7722985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:27.050003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66df806-2742-4db9-869b-835bd7722985 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.050258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66df806-2742-4db9-869b-835bd7722985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.050531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66df806-2742-4db9-869b-835bd7722985 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.051175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66df806-2742-4db9-869b-835bd7722985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:27.053078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66df806-2742-4db9-869b-835bd7722985 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:27.074229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 941/1894] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:26 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:27.078299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9267f-5f34-4ac9-9cca-6400926c2923 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:27.088975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9267f-5f34-4ac9-9cca-6400926c2923 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:27.093511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99c2a5-0af5-4d34-aba0-26b3f8a87f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:27.094104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c2a5-0af5-4d34-aba0-26b3f8a87f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.094376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c2a5-0af5-4d34-aba0-26b3f8a87f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.094644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c2a5-0af5-4d34-aba0-26b3f8a87f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.095277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c2a5-0af5-4d34-aba0-26b3f8a87f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:27.096872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c2a5-0af5-4d34-aba0-26b3f8a87f81 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:27.106827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 954/1895] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:27.111041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66df806-2742-4db9-869b-835bd7722985 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:27.121299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66df806-2742-4db9-869b-835bd7722985 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:27.125985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511742c-0f15-4992-933a-d2ef4de6f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:27.126579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511742c-0f15-4992-933a-d2ef4de6f0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.126859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511742c-0f15-4992-933a-d2ef4de6f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.127134 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511742c-0f15-4992-933a-d2ef4de6f0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.127781 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511742c-0f15-4992-933a-d2ef4de6f0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:27.129936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511742c-0f15-4992-933a-d2ef4de6f0d8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:27.140901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 942/1896] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:27.144968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99c2a5-0af5-4d34-aba0-26b3f8a87f81 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:27.155531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99c2a5-0af5-4d34-aba0-26b3f8a87f81 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:27.160098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:27.160736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.161012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.161282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] PATH_INFO: `/v3/projects/1f64c53c12ad43438685e04230864a80/users/c721aa19a74d4275b411452db0f3c8f2/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.175865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f64c53c12ad43438685e04230864a80, user_id=c721aa19a74d4275b411452db0f3c8f2, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:27.178635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:27.192122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 955/1897] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:27 2022] PUT /identity/v3/projects/1f64c53c12ad43438685e04230864a80/users/c721aa19a74d4275b411452db0f3c8f2/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:27.203161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013614e-9de8-426a-8053-260f0aadf607 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.203449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013614e-9de8-426a-8053-260f0aadf607 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.203721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013614e-9de8-426a-8053-260f0aadf607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.231770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d013614e-9de8-426a-8053-260f0aadf607 None None] MFA Rules not processed for user `c721aa19a74d4275b411452db0f3c8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:27.233027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d013614e-9de8-426a-8053-260f0aadf607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:27.296014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 943/1898] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:27.307075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:27.308751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:27.330126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:27.366259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d5e6-5d4e-4569-8a60-13ec0ce812b2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:27.370346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd060b-027c-4b64-80ad-4c494f228b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:27.370947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd060b-027c-4b64-80ad-4c494f228b4d service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.371217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd060b-027c-4b64-80ad-4c494f228b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.371492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd060b-027c-4b64-80ad-4c494f228b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.379491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd060b-027c-4b64-80ad-4c494f228b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:27.380902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd060b-027c-4b64-80ad-4c494f228b4d service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:27.389978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 956/1899] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:30.004549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013614e-9de8-426a-8053-260f0aadf607 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.007064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d013614e-9de8-426a-8053-260f0aadf607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.033653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:30.094932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013614e-9de8-426a-8053-260f0aadf607 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.100402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.101175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.101995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.102516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] PATH_INFO: `/v3/users/c3b1bf39290345a58aed7d2b2606d9b8` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.103793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b1bf39290345a58aed7d2b2606d9b8)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.107581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.185103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b1bf39290345a58aed7d2b2606d9b8'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.215967 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b1bf39290345a58aed7d2b2606d9b8'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.217270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b1bf39290345a58aed7d2b2606d9b8'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.231669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b1bf39290345a58aed7d2b2606d9b8'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.237960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b1bf39290345a58aed7d2b2606d9b8'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.272353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 944/1900] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:30 2022] DELETE /identity/v3/users/c3b1bf39290345a58aed7d2b2606d9b8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:30.276861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0ea0-25c9-405a-b813-e48ba545b3b3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.277792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0ea0-25c9-405a-b813-e48ba545b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.278398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0ea0-25c9-405a-b813-e48ba545b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.309182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ceab0ea0-25c9-405a-b813-e48ba545b3b3 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:30.310424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ceab0ea0-25c9-405a-b813-e48ba545b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.380230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 957/1901] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:30.390427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.391861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.470270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceba4ca-b0fc-4d4e-b7a1-9e431598b07e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.474252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13fb7e-be7b-4ea8-b6be-087d7147e4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.474852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13fb7e-be7b-4ea8-b6be-087d7147e4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.475129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13fb7e-be7b-4ea8-b6be-087d7147e4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.475397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13fb7e-be7b-4ea8-b6be-087d7147e4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.485255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13fb7e-be7b-4ea8-b6be-087d7147e4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.486537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13fb7e-be7b-4ea8-b6be-087d7147e4dc service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.501780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 945/1902] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:30.849927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0ea0-25c9-405a-b813-e48ba545b3b3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.851309 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ceab0ea0-25c9-405a-b813-e48ba545b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.863666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0ea0-25c9-405a-b813-e48ba545b3b3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.868517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.869157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.869437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.869742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] PATH_INFO: `/v3/projects/a27731b708cd4bae8e4219d2b52e457f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.871732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27731b708cd4bae8e4219d2b52e457f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.874404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.934040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27731b708cd4bae8e4219d2b52e457f', 'request_id': 'req-c3b9c033-5a4d-452b-9b81-e6983d192e85'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.939774 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27731b708cd4bae8e4219d2b52e457f', 'request_id': 'req-c3b9c033-5a4d-452b-9b81-e6983d192e85'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.946548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27731b708cd4bae8e4219d2b52e457f', 'request_id': 'req-c3b9c033-5a4d-452b-9b81-e6983d192e85'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.958900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] The token cache is being invalidate because project a27731b708cd4bae8e4219d2b52e457f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:30.959184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.959792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c3b9c033-5a4d-452b-9b81-e6983d192e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.961949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 958/1903] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:30 2022] DELETE /identity/v3/projects/a27731b708cd4bae8e4219d2b52e457f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:30.966748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b126c9-0b04-458b-b60e-e37fea02034b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.967027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b126c9-0b04-458b-b60e-e37fea02034b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.967295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b126c9-0b04-458b-b60e-e37fea02034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.989708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f4b126c9-0b04-458b-b60e-e37fea02034b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:30.990920 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f4b126c9-0b04-458b-b60e-e37fea02034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.025244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:31.051481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 946/1904] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:31.059785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52437b6-e1fd-434a-906d-fae846ca4ccd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.060072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52437b6-e1fd-434a-906d-fae846ca4ccd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.060348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52437b6-e1fd-434a-906d-fae846ca4ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.080734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a52437b6-e1fd-434a-906d-fae846ca4ccd None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:31.081973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a52437b6-e1fd-434a-906d-fae846ca4ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.090401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 959/1905] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:31.094617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b126c9-0b04-458b-b60e-e37fea02034b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.104828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b126c9-0b04-458b-b60e-e37fea02034b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.110206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.110809 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.111085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.111353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.111998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:31.112301 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.113923 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.125861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 947/1906] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:31.130292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52437b6-e1fd-434a-906d-fae846ca4ccd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.140711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52437b6-e1fd-434a-906d-fae846ca4ccd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.145751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883bb3-20bb-4918-b483-983170475e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.146378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883bb3-20bb-4918-b483-983170475e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.146650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883bb3-20bb-4918-b483-983170475e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.146917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883bb3-20bb-4918-b483-983170475e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.147542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883bb3-20bb-4918-b483-983170475e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.149475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883bb3-20bb-4918-b483-983170475e69 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.175399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 960/1907] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:31.179440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.189623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a44cd-213f-4332-bc4c-af29ddb69d21 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.247523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33e9a-973f-4f96-9f52-e8ab365e984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.248132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33e9a-973f-4f96-9f52-e8ab365e984d admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.248407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33e9a-973f-4f96-9f52-e8ab365e984d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.248682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33e9a-973f-4f96-9f52-e8ab365e984d admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.249343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33e9a-973f-4f96-9f52-e8ab365e984d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.251261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33e9a-973f-4f96-9f52-e8ab365e984d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.272371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 948/1908] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:31.276441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883bb3-20bb-4918-b483-983170475e69 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.286618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883bb3-20bb-4918-b483-983170475e69 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.291779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54df2b-683b-4b21-a9b9-78f6cb2c094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.292393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54df2b-683b-4b21-a9b9-78f6cb2c094f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.292653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54df2b-683b-4b21-a9b9-78f6cb2c094f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.292921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54df2b-683b-4b21-a9b9-78f6cb2c094f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.293591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54df2b-683b-4b21-a9b9-78f6cb2c094f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.295289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54df2b-683b-4b21-a9b9-78f6cb2c094f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.307368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 961/1909] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:31.311361 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33e9a-973f-4f96-9f52-e8ab365e984d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.322405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33e9a-973f-4f96-9f52-e8ab365e984d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.327166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94e909-5b3b-42f8-a71c-0ce569577032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.327656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e909-5b3b-42f8-a71c-0ce569577032 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.327909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e909-5b3b-42f8-a71c-0ce569577032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.328178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e909-5b3b-42f8-a71c-0ce569577032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.328820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94e909-5b3b-42f8-a71c-0ce569577032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.330471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94e909-5b3b-42f8-a71c-0ce569577032 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.341168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 949/1910] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:31.345458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54df2b-683b-4b21-a9b9-78f6cb2c094f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.356330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54df2b-683b-4b21-a9b9-78f6cb2c094f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.361172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.361883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.362177 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.362432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] PATH_INFO: `/v3/projects/159e3573c405472baf7efac53e8a7b99/users/fdf8adbf99e640de8419efe9d8640b47/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.364725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:31.381257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159e3573c405472baf7efac53e8a7b99, user_id=fdf8adbf99e640de8419efe9d8640b47, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.384575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.398372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 962/1911] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:31 2022] PUT /identity/v3/projects/159e3573c405472baf7efac53e8a7b99/users/fdf8adbf99e640de8419efe9d8640b47/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:31.409395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c311-1acc-4efe-ba6a-2105b1bc8087 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.409711 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c311-1acc-4efe-ba6a-2105b1bc8087 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.409987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852c311-1acc-4efe-ba6a-2105b1bc8087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.438786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-6852c311-1acc-4efe-ba6a-2105b1bc8087 None None] MFA Rules not processed for user `fdf8adbf99e640de8419efe9d8640b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:31.440029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6852c311-1acc-4efe-ba6a-2105b1bc8087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.505982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 950/1912] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:31.517064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.518776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.573879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0131cf-c5b4-4674-a1ef-9920faf93626 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.577521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08f91f-191e-45f8-8ba2-021dfbfeb298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.578125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08f91f-191e-45f8-8ba2-021dfbfeb298 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.578398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08f91f-191e-45f8-8ba2-021dfbfeb298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.578664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08f91f-191e-45f8-8ba2-021dfbfeb298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.587666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08f91f-191e-45f8-8ba2-021dfbfeb298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.589138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08f91f-191e-45f8-8ba2-021dfbfeb298 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.598081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 963/1913] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:31.608958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852c311-1acc-4efe-ba6a-2105b1bc8087 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.610770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6852c311-1acc-4efe-ba6a-2105b1bc8087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.652113 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:31.680518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852c311-1acc-4efe-ba6a-2105b1bc8087 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.685382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.686039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.686316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.686589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] PATH_INFO: `/v3/users/c721aa19a74d4275b411452db0f3c8f2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.687730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c721aa19a74d4275b411452db0f3c8f2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.689702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.740296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c721aa19a74d4275b411452db0f3c8f2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:31.754449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c721aa19a74d4275b411452db0f3c8f2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:31.755286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c721aa19a74d4275b411452db0f3c8f2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:31.763581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c721aa19a74d4275b411452db0f3c8f2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:31.764214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c721aa19a74d4275b411452db0f3c8f2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:31.779672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 951/1914] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:31 2022] DELETE /identity/v3/users/c721aa19a74d4275b411452db0f3c8f2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:31.783959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571922c-50ca-4b7d-b1db-82b94e28c922 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.784266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571922c-50ca-4b7d-b1db-82b94e28c922 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.784637 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571922c-50ca-4b7d-b1db-82b94e28c922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.807785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7571922c-50ca-4b7d-b1db-82b94e28c922 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:31.809009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7571922c-50ca-4b7d-b1db-82b94e28c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.901004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 964/1915] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:31.913260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.914788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.978096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f532527-f284-4194-b95c-6de33740475e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.982057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16b832-f34d-4069-a281-d3475631226d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.982707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16b832-f34d-4069-a281-d3475631226d service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.982986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16b832-f34d-4069-a281-d3475631226d service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.983254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16b832-f34d-4069-a281-d3475631226d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.993625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16b832-f34d-4069-a281-d3475631226d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.995233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16b832-f34d-4069-a281-d3475631226d service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.005006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 952/1916] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:32.299271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571922c-50ca-4b7d-b1db-82b94e28c922 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.300702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7571922c-50ca-4b7d-b1db-82b94e28c922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.322876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571922c-50ca-4b7d-b1db-82b94e28c922 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.328152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.328803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.329079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.329405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] PATH_INFO: `/v3/projects/1f64c53c12ad43438685e04230864a80` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.330758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f64c53c12ad43438685e04230864a80)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.332728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.379940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f64c53c12ad43438685e04230864a80', 'request_id': 'req-cff0b94b-9833-449e-89bb-7aa9fa317cd2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.385453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f64c53c12ad43438685e04230864a80', 'request_id': 'req-cff0b94b-9833-449e-89bb-7aa9fa317cd2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.391792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f64c53c12ad43438685e04230864a80', 'request_id': 'req-cff0b94b-9833-449e-89bb-7aa9fa317cd2'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.403873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] The token cache is being invalidate because project 1f64c53c12ad43438685e04230864a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:32.404159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.404772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cff0b94b-9833-449e-89bb-7aa9fa317cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.406293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 965/1917] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:32 2022] DELETE /identity/v3/projects/1f64c53c12ad43438685e04230864a80 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:32.411262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355399df-146e-4465-bdfb-1a756c8dfa9a None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.411708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355399df-146e-4465-bdfb-1a756c8dfa9a None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.411839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355399df-146e-4465-bdfb-1a756c8dfa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.433350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-355399df-146e-4465-bdfb-1a756c8dfa9a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:32.434600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-355399df-146e-4465-bdfb-1a756c8dfa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.483070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:32.499050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 953/1918] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:32.560340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554ce34-da3d-41bd-8b37-f980342a4ec2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.560626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554ce34-da3d-41bd-8b37-f980342a4ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.560899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554ce34-da3d-41bd-8b37-f980342a4ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.581076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2554ce34-da3d-41bd-8b37-f980342a4ec2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:32.582324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2554ce34-da3d-41bd-8b37-f980342a4ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.590230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 966/1919] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:32.594441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355399df-146e-4465-bdfb-1a756c8dfa9a None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.604417 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355399df-146e-4465-bdfb-1a756c8dfa9a None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.609665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.610351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.610698 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.611039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.611759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:32.612138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.613842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.626175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 954/1920] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:32.630736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554ce34-da3d-41bd-8b37-f980342a4ec2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.635763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:32.655403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554ce34-da3d-41bd-8b37-f980342a4ec2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.674018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ed9ea-06d7-43fb-b02d-4bcddd98424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.674748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ed9ea-06d7-43fb-b02d-4bcddd98424e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.675030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ed9ea-06d7-43fb-b02d-4bcddd98424e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.675303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ed9ea-06d7-43fb-b02d-4bcddd98424e admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.675994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ed9ea-06d7-43fb-b02d-4bcddd98424e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.678402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ed9ea-06d7-43fb-b02d-4bcddd98424e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.708303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 967/1921] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:32.713015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.727288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fbdf6-2690-4967-86a2-e39c17b8c0e0 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.785859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096f292-8d2f-48f9-afb5-36697214c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.786472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f292-8d2f-48f9-afb5-36697214c56a admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.786779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f292-8d2f-48f9-afb5-36697214c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.787145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f292-8d2f-48f9-afb5-36697214c56a admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.787649 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096f292-8d2f-48f9-afb5-36697214c56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.790289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096f292-8d2f-48f9-afb5-36697214c56a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.813541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 955/1922] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:32.815974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ed9ea-06d7-43fb-b02d-4bcddd98424e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.828098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ed9ea-06d7-43fb-b02d-4bcddd98424e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.834368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617254e5-f805-4305-a840-adaf05d838d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.835062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617254e5-f805-4305-a840-adaf05d838d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.836287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617254e5-f805-4305-a840-adaf05d838d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.837172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617254e5-f805-4305-a840-adaf05d838d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.837998 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617254e5-f805-4305-a840-adaf05d838d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.839688 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617254e5-f805-4305-a840-adaf05d838d1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.851462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 968/1923] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:32.855415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096f292-8d2f-48f9-afb5-36697214c56a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.866807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096f292-8d2f-48f9-afb5-36697214c56a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.871944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ddc8-f10f-4c9d-bb5d-806010c24b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.872557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ddc8-f10f-4c9d-bb5d-806010c24b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.872834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ddc8-f10f-4c9d-bb5d-806010c24b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.873108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ddc8-f10f-4c9d-bb5d-806010c24b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.873801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4ddc8-f10f-4c9d-bb5d-806010c24b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.875801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4ddc8-f10f-4c9d-bb5d-806010c24b67 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.891211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617254e5-f805-4305-a840-adaf05d838d1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.892640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 956/1924] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:32.907258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617254e5-f805-4305-a840-adaf05d838d1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.915536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0d63b-a88d-4ad1-807d-4160bdf7a86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.917407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0d63b-a88d-4ad1-807d-4160bdf7a86e admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.918459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0d63b-a88d-4ad1-807d-4160bdf7a86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.918882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0d63b-a88d-4ad1-807d-4160bdf7a86e admin admin] PATH_INFO: `/v3/projects/909a7366bbbf4c66af33bf7256e62921/users/a1aca4ca4d774a6c934a1a44ce9ea561/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.947469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0d63b-a88d-4ad1-807d-4160bdf7a86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=909a7366bbbf4c66af33bf7256e62921, user_id=a1aca4ca4d774a6c934a1a44ce9ea561, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.950529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0d63b-a88d-4ad1-807d-4160bdf7a86e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.974731 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 969/1925] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:32 2022] PUT /identity/v3/projects/909a7366bbbf4c66af33bf7256e62921/users/a1aca4ca4d774a6c934a1a44ce9ea561/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:32.986029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42de8-f6ac-4f4a-a5bc-39490fe84709 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.986303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42de8-f6ac-4f4a-a5bc-39490fe84709 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.986579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42de8-f6ac-4f4a-a5bc-39490fe84709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.024495 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f1f2-ad80-41fa-b465-3aac610365be None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.025346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f1f2-ad80-41fa-b465-3aac610365be None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.025703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f1f2-ad80-41fa-b465-3aac610365be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.053936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9b74f1f2-ad80-41fa-b465-3aac610365be None None] MFA Rules not processed for user `fdf8adbf99e640de8419efe9d8640b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:33.055960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9b74f1f2-ad80-41fa-b465-3aac610365be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.057152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c0d42de8-f6ac-4f4a-a5bc-39490fe84709 None None] MFA Rules not processed for user `a1aca4ca4d774a6c934a1a44ce9ea561`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:33.059239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c0d42de8-f6ac-4f4a-a5bc-39490fe84709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.125095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 970/1926] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:33.133136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 957/1927] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:33.137617 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74f1f2-ad80-41fa-b465-3aac610365be None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.214005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74f1f2-ad80-41fa-b465-3aac610365be None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.219447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24377fc-c70f-4e05-b499-f314d89fa623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.220084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24377fc-c70f-4e05-b499-f314d89fa623 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.220443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24377fc-c70f-4e05-b499-f314d89fa623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.220703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24377fc-c70f-4e05-b499-f314d89fa623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.221353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24377fc-c70f-4e05-b499-f314d89fa623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.223362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24377fc-c70f-4e05-b499-f314d89fa623 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.252280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 971/1928] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:33.256311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d42de8-f6ac-4f4a-a5bc-39490fe84709 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.267181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d42de8-f6ac-4f4a-a5bc-39490fe84709 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.315227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:33.328166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af494520-0d11-455a-9103-fc6f355683ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.328696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494520-0d11-455a-9103-fc6f355683ce admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.328974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494520-0d11-455a-9103-fc6f355683ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.329247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af494520-0d11-455a-9103-fc6f355683ce admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.329931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af494520-0d11-455a-9103-fc6f355683ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.331848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af494520-0d11-455a-9103-fc6f355683ce admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.355460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 958/1929] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:33.359834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24377fc-c70f-4e05-b499-f314d89fa623 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.370867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24377fc-c70f-4e05-b499-f314d89fa623 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.377428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2721-3329-44c3-9719-847cb1e62372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.378172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2721-3329-44c3-9719-847cb1e62372 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.378451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2721-3329-44c3-9719-847cb1e62372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.378723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2721-3329-44c3-9719-847cb1e62372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.379381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb2721-3329-44c3-9719-847cb1e62372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.381095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb2721-3329-44c3-9719-847cb1e62372 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.392029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 972/1930] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:33.396174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af494520-0d11-455a-9103-fc6f355683ce admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.406887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af494520-0d11-455a-9103-fc6f355683ce admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.411758 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f8636-a75d-4f3f-8dd6-d3abe617bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.412311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f8636-a75d-4f3f-8dd6-d3abe617bff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.412568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f8636-a75d-4f3f-8dd6-d3abe617bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.412839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f8636-a75d-4f3f-8dd6-d3abe617bff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.419304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f8636-a75d-4f3f-8dd6-d3abe617bff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.420945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f8636-a75d-4f3f-8dd6-d3abe617bff3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.433537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 959/1931] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:33.437087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2721-3329-44c3-9719-847cb1e62372 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.447959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2721-3329-44c3-9719-847cb1e62372 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.452543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586437-a0f7-4c2b-930f-b7a98b4c99bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.453219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586437-a0f7-4c2b-930f-b7a98b4c99bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.453513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586437-a0f7-4c2b-930f-b7a98b4c99bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.453791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586437-a0f7-4c2b-930f-b7a98b4c99bd admin admin] PATH_INFO: `/v3/projects/5b5e575a3fb844ac95462a2864f5058f/users/90bd93b8b0fb456bb28d9b5c9d151e39/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.469800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53586437-a0f7-4c2b-930f-b7a98b4c99bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5e575a3fb844ac95462a2864f5058f, user_id=90bd93b8b0fb456bb28d9b5c9d151e39, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.472514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53586437-a0f7-4c2b-930f-b7a98b4c99bd admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.482850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:33.488378 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 973/1932] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:33 2022] PUT /identity/v3/projects/5b5e575a3fb844ac95462a2864f5058f/users/90bd93b8b0fb456bb28d9b5c9d151e39/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:33.498721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66458-0597-47d0-9c2b-3cf24695d6e3 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.499064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66458-0597-47d0-9c2b-3cf24695d6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.499264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e66458-0597-47d0-9c2b-3cf24695d6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.528806 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-52e66458-0597-47d0-9c2b-3cf24695d6e3 None None] MFA Rules not processed for user `90bd93b8b0fb456bb28d9b5c9d151e39`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:33.530061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-52e66458-0597-47d0-9c2b-3cf24695d6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.595273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 960/1933] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:33.599696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586437-a0f7-4c2b-930f-b7a98b4c99bd admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.664857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586437-a0f7-4c2b-930f-b7a98b4c99bd admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.670010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa373a-9def-4f61-848b-3fc85816beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.670619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa373a-9def-4f61-848b-3fc85816beb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.670894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa373a-9def-4f61-848b-3fc85816beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.671164 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa373a-9def-4f61-848b-3fc85816beb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.671941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa373a-9def-4f61-848b-3fc85816beb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.673905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa373a-9def-4f61-848b-3fc85816beb1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.705606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 974/1934] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:33.707017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e66458-0597-47d0-9c2b-3cf24695d6e3 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.727080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e66458-0597-47d0-9c2b-3cf24695d6e3 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.807666 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd730fd4-79e2-45f3-9356-dfc1a3dcd5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.809436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd730fd4-79e2-45f3-9356-dfc1a3dcd5aa admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.809752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd730fd4-79e2-45f3-9356-dfc1a3dcd5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.810459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd730fd4-79e2-45f3-9356-dfc1a3dcd5aa admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.810661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd730fd4-79e2-45f3-9356-dfc1a3dcd5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.812904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd730fd4-79e2-45f3-9356-dfc1a3dcd5aa admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.849652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 961/1935] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:33.850802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa373a-9def-4f61-848b-3fc85816beb1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.869704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa373a-9def-4f61-848b-3fc85816beb1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.869704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb0e8-f827-4d5e-aa10-4b89e0f13dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.869704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb0e8-f827-4d5e-aa10-4b89e0f13dda admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.869704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb0e8-f827-4d5e-aa10-4b89e0f13dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.870048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bb0e8-f827-4d5e-aa10-4b89e0f13dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.870579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bb0e8-f827-4d5e-aa10-4b89e0f13dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.872199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bb0e8-f827-4d5e-aa10-4b89e0f13dda admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.888633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 975/1936] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:33.890209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd730fd4-79e2-45f3-9356-dfc1a3dcd5aa admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.903517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd730fd4-79e2-45f3-9356-dfc1a3dcd5aa admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.908631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c33ef7-1283-4714-b5c7-5b9d1824af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.909363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c33ef7-1283-4714-b5c7-5b9d1824af9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.909751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c33ef7-1283-4714-b5c7-5b9d1824af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.910102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c33ef7-1283-4714-b5c7-5b9d1824af9d admin admin] PATH_INFO: `/v3/projects/8a9a09173e474a91a5384875bd5c48e2/users/58f404350a1544589d04f1b8e83a3ac1/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.930377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c33ef7-1283-4714-b5c7-5b9d1824af9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9a09173e474a91a5384875bd5c48e2, user_id=58f404350a1544589d04f1b8e83a3ac1, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.933974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c33ef7-1283-4714-b5c7-5b9d1824af9d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.953495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 962/1937] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:33 2022] PUT /identity/v3/projects/8a9a09173e474a91a5384875bd5c48e2/users/58f404350a1544589d04f1b8e83a3ac1/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:33.957648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb0e8-f827-4d5e-aa10-4b89e0f13dda admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.989517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bb0e8-f827-4d5e-aa10-4b89e0f13dda admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.088369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b27582-d739-4478-949c-3a7041f7e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.089064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27582-d739-4478-949c-3a7041f7e17f admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.089405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27582-d739-4478-949c-3a7041f7e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.089944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27582-d739-4478-949c-3a7041f7e17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.090670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b27582-d739-4478-949c-3a7041f7e17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.092425 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b27582-d739-4478-949c-3a7041f7e17f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.124066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 976/1938] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:34.128741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c33ef7-1283-4714-b5c7-5b9d1824af9d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.148543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c33ef7-1283-4714-b5c7-5b9d1824af9d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.161828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.162625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.162905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.163910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] PATH_INFO: `/v3/projects/8a9a09173e474a91a5384875bd5c48e2/users/58f404350a1544589d04f1b8e83a3ac1/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.170321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9a09173e474a91a5384875bd5c48e2, user_id=58f404350a1544589d04f1b8e83a3ac1, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.176509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.216761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 963/1939] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:34 2022] PUT /identity/v3/projects/8a9a09173e474a91a5384875bd5c48e2/users/58f404350a1544589d04f1b8e83a3ac1/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:34.228782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53e67-bd98-4349-8d37-b854a80f9dfc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.229071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53e67-bd98-4349-8d37-b854a80f9dfc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.229346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b53e67-bd98-4349-8d37-b854a80f9dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.281414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-97b53e67-bd98-4349-8d37-b854a80f9dfc None None] MFA Rules not processed for user `58f404350a1544589d04f1b8e83a3ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:34.282910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-97b53e67-bd98-4349-8d37-b854a80f9dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:34.352472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:34.365583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 977/1940] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:34.374408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.376217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:34.395070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:34.447663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa906-02d6-488c-8fb0-cc349195ca13 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.451261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1480e1b-036a-4c76-973b-bdbd22039a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.451859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1480e1b-036a-4c76-973b-bdbd22039a1d service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.452132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1480e1b-036a-4c76-973b-bdbd22039a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.452399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1480e1b-036a-4c76-973b-bdbd22039a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.507528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1480e1b-036a-4c76-973b-bdbd22039a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.509112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1480e1b-036a-4c76-973b-bdbd22039a1d service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.517754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 964/1941] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:35.309506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b53e67-bd98-4349-8d37-b854a80f9dfc None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.311056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-97b53e67-bd98-4349-8d37-b854a80f9dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:35.387098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b53e67-bd98-4349-8d37-b854a80f9dfc None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.391715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.392360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.392635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.392906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] PATH_INFO: `/v3/users/f7e3c1152e34448eb540884452293994` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.394230 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e3c1152e34448eb540884452293994)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.396156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.461743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e3c1152e34448eb540884452293994'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.485699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e3c1152e34448eb540884452293994'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.486428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e3c1152e34448eb540884452293994'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.495804 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e3c1152e34448eb540884452293994'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.496550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e3c1152e34448eb540884452293994'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.510791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 978/1942] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:35 2022] DELETE /identity/v3/users/f7e3c1152e34448eb540884452293994 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:35.515257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68ae6-bf1c-4f9f-94db-6aee4ce49977 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.515708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68ae6-bf1c-4f9f-94db-6aee4ce49977 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.515945 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e68ae6-bf1c-4f9f-94db-6aee4ce49977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.536833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b3e68ae6-bf1c-4f9f-94db-6aee4ce49977 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:35.538298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b3e68ae6-bf1c-4f9f-94db-6aee4ce49977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:35.610914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 965/1943] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:35.621168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.622653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:35.693709 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35096970-5188-4235-aa8b-3e798992582e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.697948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.698684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.698972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.699242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.713842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.715278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.724984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 979/1944] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:36.058731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e68ae6-bf1c-4f9f-94db-6aee4ce49977 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.059011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.060143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b3e68ae6-bf1c-4f9f-94db-6aee4ce49977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.060913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.075844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e68ae6-bf1c-4f9f-94db-6aee4ce49977 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.081155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.081829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.082126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.082461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] PATH_INFO: `/v3/projects/34f038cd00b64b33b03fc031df4ac12c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.083810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f038cd00b64b33b03fc031df4ac12c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.087129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.098746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:36.142769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f038cd00b64b33b03fc031df4ac12c', 'request_id': 'req-87def22e-7a8a-4ece-b580-23b243aff5b3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.144965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaee610-488e-4037-9026-b9c4ec483874 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.148896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f038cd00b64b33b03fc031df4ac12c', 'request_id': 'req-87def22e-7a8a-4ece-b580-23b243aff5b3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.155254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f038cd00b64b33b03fc031df4ac12c', 'request_id': 'req-87def22e-7a8a-4ece-b580-23b243aff5b3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.156873 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:36.170696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] The token cache is being invalidate because project 34f038cd00b64b33b03fc031df4ac12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:36.170988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.171619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-87def22e-7a8a-4ece-b580-23b243aff5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.173589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 966/1945] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:36 2022] DELETE /identity/v3/projects/34f038cd00b64b33b03fc031df4ac12c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:36.178398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5add-bb15-448f-b61e-c14eb645468d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.178704 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5add-bb15-448f-b61e-c14eb645468d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.179013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5add-bb15-448f-b61e-c14eb645468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.198953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2fcd5add-bb15-448f-b61e-c14eb645468d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:36.200144 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2fcd5add-bb15-448f-b61e-c14eb645468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.204115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.204725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.205006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.205690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.207384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.260611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 967/1946] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:36.269616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b503aa-36cc-4e83-9bf3-5b198f6f9177 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.269905 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b503aa-36cc-4e83-9bf3-5b198f6f9177 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.270180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b503aa-36cc-4e83-9bf3-5b198f6f9177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.270704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.272449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.281462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 980/1947] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:36.290738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-98b503aa-36cc-4e83-9bf3-5b198f6f9177 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:36.292031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-98b503aa-36cc-4e83-9bf3-5b198f6f9177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.300601 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 968/1948] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:36.305610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.316130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50b0ab-a2c2-41a6-8462-7309b322efe5 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.321005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.321634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.321905 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.322172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.322806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:36.323106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.324681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.336639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 981/1949] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:36.341524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b503aa-36cc-4e83-9bf3-5b198f6f9177 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.351574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b503aa-36cc-4e83-9bf3-5b198f6f9177 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.357355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6124a36-0ba6-4516-98a2-ae73510db9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.358115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6124a36-0ba6-4516-98a2-ae73510db9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.358914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6124a36-0ba6-4516-98a2-ae73510db9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.359442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6124a36-0ba6-4516-98a2-ae73510db9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.360079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6124a36-0ba6-4516-98a2-ae73510db9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.362669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6124a36-0ba6-4516-98a2-ae73510db9c4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.396579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 969/1950] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:36 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:36.397727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.407781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111576ab-3b94-4d09-b36e-f465415dd92b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.466749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1ea5d-f1ca-4a06-8569-4ad13123baaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.467440 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ea5d-f1ca-4a06-8569-4ad13123baaa admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.467724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ea5d-f1ca-4a06-8569-4ad13123baaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.467992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1ea5d-f1ca-4a06-8569-4ad13123baaa admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.468631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1ea5d-f1ca-4a06-8569-4ad13123baaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.470619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1ea5d-f1ca-4a06-8569-4ad13123baaa admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.493262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 982/1951] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:36 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:36.497319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6124a36-0ba6-4516-98a2-ae73510db9c4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.508623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6124a36-0ba6-4516-98a2-ae73510db9c4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.513248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36753381-7215-4af5-ac48-de9faf894db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.513816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753381-7215-4af5-ac48-de9faf894db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.514088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753381-7215-4af5-ac48-de9faf894db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.514350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36753381-7215-4af5-ac48-de9faf894db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.514994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36753381-7215-4af5-ac48-de9faf894db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.516687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36753381-7215-4af5-ac48-de9faf894db2 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.529725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 970/1952] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:36.533956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1ea5d-f1ca-4a06-8569-4ad13123baaa admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.542606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:36.550595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1ea5d-f1ca-4a06-8569-4ad13123baaa admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.558470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cff79-b9b8-4189-9d00-69b6640729e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.559113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cff79-b9b8-4189-9d00-69b6640729e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.559405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cff79-b9b8-4189-9d00-69b6640729e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.559662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cff79-b9b8-4189-9d00-69b6640729e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.560523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cff79-b9b8-4189-9d00-69b6640729e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.562193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cff79-b9b8-4189-9d00-69b6640729e3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.579194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 983/1953] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:01:36.583152 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36753381-7215-4af5-ac48-de9faf894db2 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.602739 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36753381-7215-4af5-ac48-de9faf894db2 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.614030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.614728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.615008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.615340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] PATH_INFO: `/v3/projects/97fa795966724ea89be8ac20675b589b/users/accfa9fc356a4ccca7332118e8b9c421/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.657785 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fa795966724ea89be8ac20675b589b, user_id=accfa9fc356a4ccca7332118e8b9c421, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.663572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.687650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 971/1954] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:36 2022] PUT /identity/v3/projects/97fa795966724ea89be8ac20675b589b/users/accfa9fc356a4ccca7332118e8b9c421/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:36.692931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5231e-e439-484e-9800-cd062f17d4be None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.693462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5231e-e439-484e-9800-cd062f17d4be None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.694092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5231e-e439-484e-9800-cd062f17d4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.717355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0ce5231e-e439-484e-9800-cd062f17d4be None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:36.718964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0ce5231e-e439-484e-9800-cd062f17d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.796451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 984/1955] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:36.802981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.804915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.867999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263c2c1-6c90-4573-9a21-38a619313899 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.872164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f75a39-376d-4e38-8a2e-65824f5b5a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.872776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f75a39-376d-4e38-8a2e-65824f5b5a10 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.873062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f75a39-376d-4e38-8a2e-65824f5b5a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.873382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f75a39-376d-4e38-8a2e-65824f5b5a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.883528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f75a39-376d-4e38-8a2e-65824f5b5a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.884952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f75a39-376d-4e38-8a2e-65824f5b5a10 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.897688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 972/1956] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:36.974832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5231e-e439-484e-9800-cd062f17d4be None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.977036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0ce5231e-e439-484e-9800-cd062f17d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:37.096711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5231e-e439-484e-9800-cd062f17d4be None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:37.101420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:37.102503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:37.103074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:37.103478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:37.119194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:37.232540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:37.234040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:37.245333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 985/1957] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:41.455101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091491-94a0-452c-bd86-05addc35faec None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.456232 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091491-94a0-452c-bd86-05addc35faec None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.456717 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091491-94a0-452c-bd86-05addc35faec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.503724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-bc091491-94a0-452c-bd86-05addc35faec None None] MFA Rules not processed for user `0bcbf6513b6a4df3b044fadfb7888d54`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:41.507906 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bc091491-94a0-452c-bd86-05addc35faec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.565514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:41.573448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.575615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.613928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 973/1958] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:41.615490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc3d37-c9d0-4912-8a1a-db5bd2f538c2 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.622162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.623093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.623478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.624020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] PATH_INFO: `/v3/users/a1aca4ca4d774a6c934a1a44ce9ea561` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.625588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1aca4ca4d774a6c934a1a44ce9ea561)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.628613 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:41.702342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:41.716278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1aca4ca4d774a6c934a1a44ce9ea561'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.739354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1aca4ca4d774a6c934a1a44ce9ea561'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.740302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1aca4ca4d774a6c934a1a44ce9ea561'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.753886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1aca4ca4d774a6c934a1a44ce9ea561'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.754676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1aca4ca4d774a6c934a1a44ce9ea561'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.775937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 986/1959] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:41 2022] DELETE /identity/v3/users/a1aca4ca4d774a6c934a1a44ce9ea561 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:41.779503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151cce9-7e0d-442b-8b73-01c443c54aca None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.779982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151cce9-7e0d-442b-8b73-01c443c54aca None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.780352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151cce9-7e0d-442b-8b73-01c443c54aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.819174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-4151cce9-7e0d-442b-8b73-01c443c54aca None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:41.823569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4151cce9-7e0d-442b-8b73-01c443c54aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.917969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 974/1960] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:41.968529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.974183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.082816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250005f2-cbb9-4ee3-8507-6dc4553781de None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.083241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250005f2-cbb9-4ee3-8507-6dc4553781de None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.083403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250005f2-cbb9-4ee3-8507-6dc4553781de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.103780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798e0a-08a7-428f-b72d-0eae042bbc80 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:42.108309 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:42.109008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.109638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.110122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.120671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:42.122361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:42.124730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-250005f2-cbb9-4ee3-8507-6dc4553781de None None] MFA Rules not processed for user `60860294eb284b8aa11edd42dca4ae8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:42.125982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-250005f2-cbb9-4ee3-8507-6dc4553781de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.136419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 987/1961] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:42.207033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 975/1962] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:42.791135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:42.792836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.813099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18af02-ff93-4a16-a7c8-9f81465358f2 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:42.839346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:42.842727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.843196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.843657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] PATH_INFO: `/v3/projects/909a7366bbbf4c66af33bf7256e62921` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.852839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] RBAC: Authorizing `identity:delete_project(project_id=909a7366bbbf4c66af33bf7256e62921)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:42.859110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:42.975891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909a7366bbbf4c66af33bf7256e62921', 'request_id': 'req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.984130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909a7366bbbf4c66af33bf7256e62921', 'request_id': 'req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.996580 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909a7366bbbf4c66af33bf7256e62921', 'request_id': 'req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.020892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] The token cache is being invalidate because project 909a7366bbbf4c66af33bf7256e62921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:43.021840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.023704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.029810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 988/1963] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:42 2022] DELETE /identity/v3/projects/909a7366bbbf4c66af33bf7256e62921 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:43.033676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250005f2-cbb9-4ee3-8507-6dc4553781de None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.058145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250005f2-cbb9-4ee3-8507-6dc4553781de None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:43.157434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:43.158122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.158405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.158819 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] PATH_INFO: `/v3/users/90bd93b8b0fb456bb28d9b5c9d151e39` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.159986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bd93b8b0fb456bb28d9b5c9d151e39)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:43.162317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:43.192531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:43.224519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bd93b8b0fb456bb28d9b5c9d151e39'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.239569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bd93b8b0fb456bb28d9b5c9d151e39'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.240491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bd93b8b0fb456bb28d9b5c9d151e39'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.253629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bd93b8b0fb456bb28d9b5c9d151e39'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.254797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bd93b8b0fb456bb28d9b5c9d151e39'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.276678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 976/1964] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:43 2022] DELETE /identity/v3/users/90bd93b8b0fb456bb28d9b5c9d151e39 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:43.883571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.885063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.916009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4cd10-1ae6-4a7a-abed-1468fb0d538c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.046423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:44.083190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.086202 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.086202 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.086433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] PATH_INFO: `/v3/projects/5b5e575a3fb844ac95462a2864f5058f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.087621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5e575a3fb844ac95462a2864f5058f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.089756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.307142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5e575a3fb844ac95462a2864f5058f', 'request_id': 'req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.328025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5e575a3fb844ac95462a2864f5058f', 'request_id': 'req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.347853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5e575a3fb844ac95462a2864f5058f', 'request_id': 'req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.385870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] The token cache is being invalidate because project 5b5e575a3fb844ac95462a2864f5058f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:44.386792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.390554 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a837e79d-47bb-48d0-ba60-bd9ff3c34d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.405382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 989/1965] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:43 2022] DELETE /identity/v3/projects/5b5e575a3fb844ac95462a2864f5058f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:44.410489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.417253 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.450884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f96710-2144-451e-8cff-f0971e383df7 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.581627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.582284 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.582563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.582841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] PATH_INFO: `/v3/users/58f404350a1544589d04f1b8e83a3ac1` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.584002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f404350a1544589d04f1b8e83a3ac1)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.586529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.657356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f404350a1544589d04f1b8e83a3ac1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.672462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f404350a1544589d04f1b8e83a3ac1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.673382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f404350a1544589d04f1b8e83a3ac1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.683833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f404350a1544589d04f1b8e83a3ac1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.684786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f404350a1544589d04f1b8e83a3ac1'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.703586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 977/1966] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:44 2022] DELETE /identity/v3/users/58f404350a1544589d04f1b8e83a3ac1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:44.820275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95219d7-d40e-4886-9f84-1d1dd8261f5a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.820811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95219d7-d40e-4886-9f84-1d1dd8261f5a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.821094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95219d7-d40e-4886-9f84-1d1dd8261f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.855571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e95219d7-d40e-4886-9f84-1d1dd8261f5a None None] MFA Rules not processed for user `accfa9fc356a4ccca7332118e8b9c421`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:44.857105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e95219d7-d40e-4886-9f84-1d1dd8261f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.995948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 990/1967] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:44.996566 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.999468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.039756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:45.123098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf2972-2e20-475e-81f0-1cdfdb1eb587 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.128660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1693e6-c081-4cfc-a429-09a971b515c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.133024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1693e6-c081-4cfc-a429-09a971b515c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.133450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1693e6-c081-4cfc-a429-09a971b515c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.133881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1693e6-c081-4cfc-a429-09a971b515c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.134641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1693e6-c081-4cfc-a429-09a971b515c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.135436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95219d7-d40e-4886-9f84-1d1dd8261f5a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.136992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1693e6-c081-4cfc-a429-09a971b515c9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.137280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e95219d7-d40e-4886-9f84-1d1dd8261f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.176097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95219d7-d40e-4886-9f84-1d1dd8261f5a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.181668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.182392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.182569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.182847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] PATH_INFO: `/v3/projects/8a9a09173e474a91a5384875bd5c48e2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.183990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9a09173e474a91a5384875bd5c48e2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.185979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.198196 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 978/1968] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:45.206805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1693e6-c081-4cfc-a429-09a971b515c9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.250786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9a09173e474a91a5384875bd5c48e2', 'request_id': 'req-f8598970-98ba-4782-99f2-aa5bfbe27dda'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.260991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:45.263837 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9a09173e474a91a5384875bd5c48e2', 'request_id': 'req-f8598970-98ba-4782-99f2-aa5bfbe27dda'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.276046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9a09173e474a91a5384875bd5c48e2', 'request_id': 'req-f8598970-98ba-4782-99f2-aa5bfbe27dda'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.294573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] The token cache is being invalidate because project 8a9a09173e474a91a5384875bd5c48e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:45.294926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.295854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.297899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 991/1969] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:45 2022] DELETE /identity/v3/projects/8a9a09173e474a91a5384875bd5c48e2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:45.322445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1693e6-c081-4cfc-a429-09a971b515c9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.399123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594f489-5886-4684-a627-9a1379034783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.399830 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594f489-5886-4684-a627-9a1379034783 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.400181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594f489-5886-4684-a627-9a1379034783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.400528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594f489-5886-4684-a627-9a1379034783 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.401264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594f489-5886-4684-a627-9a1379034783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.403366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594f489-5886-4684-a627-9a1379034783 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.430913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 979/1970] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:45.435033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.436468 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.450485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8598970-98ba-4782-99f2-aa5bfbe27dda admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.455409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e7f7e-e8d4-42fd-8176-8519cbd2ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.456036 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7f7e-e8d4-42fd-8176-8519cbd2ed06 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.456324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7f7e-e8d4-42fd-8176-8519cbd2ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.456649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7f7e-e8d4-42fd-8176-8519cbd2ed06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.457246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e7f7e-e8d4-42fd-8176-8519cbd2ed06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.458959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e7f7e-e8d4-42fd-8176-8519cbd2ed06 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.474584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 992/1971] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:45.479377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594f489-5886-4684-a627-9a1379034783 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.497126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594f489-5886-4684-a627-9a1379034783 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.502202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f7190-eff2-44eb-aad9-b777ce019704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.502883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f7190-eff2-44eb-aad9-b777ce019704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.503158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f7190-eff2-44eb-aad9-b777ce019704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.503433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f7190-eff2-44eb-aad9-b777ce019704 admin admin] PATH_INFO: `/v3/projects/f9c17763aab14c4cbdaef31e929da0a4/users/f59de23429ef4bbd94fd2c88456a0689/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.521278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f7190-eff2-44eb-aad9-b777ce019704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c17763aab14c4cbdaef31e929da0a4, user_id=f59de23429ef4bbd94fd2c88456a0689, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.524661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f7190-eff2-44eb-aad9-b777ce019704 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.537762 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 980/1972] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:45 2022] PUT /identity/v3/projects/f9c17763aab14c4cbdaef31e929da0a4/users/f59de23429ef4bbd94fd2c88456a0689/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:45.542387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e7f7e-e8d4-42fd-8176-8519cbd2ed06 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.553755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e7f7e-e8d4-42fd-8176-8519cbd2ed06 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.619456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa894d-ec49-4570-a1a9-91b972e3be18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.620182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa894d-ec49-4570-a1a9-91b972e3be18 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.620526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa894d-ec49-4570-a1a9-91b972e3be18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.620863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa894d-ec49-4570-a1a9-91b972e3be18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.621718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa894d-ec49-4570-a1a9-91b972e3be18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.623335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa894d-ec49-4570-a1a9-91b972e3be18 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.636946 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 993/1973] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:45.640685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f7190-eff2-44eb-aad9-b777ce019704 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.656365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f7190-eff2-44eb-aad9-b777ce019704 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.661827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.662680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.663134 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.663619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] PATH_INFO: `/v3/projects/f9c17763aab14c4cbdaef31e929da0a4/users/f59de23429ef4bbd94fd2c88456a0689/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.665761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c17763aab14c4cbdaef31e929da0a4, user_id=f59de23429ef4bbd94fd2c88456a0689, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.668643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.691652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 981/1974] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:45 2022] PUT /identity/v3/projects/f9c17763aab14c4cbdaef31e929da0a4/users/f59de23429ef4bbd94fd2c88456a0689/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:53.878608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f50f6-6072-44f8-9f4e-a112a7d98f52 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:53.879046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f50f6-6072-44f8-9f4e-a112a7d98f52 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:53.879046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f50f6-6072-44f8-9f4e-a112a7d98f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:53.912603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-182f50f6-6072-44f8-9f4e-a112a7d98f52 None None] MFA Rules not processed for user `f59de23429ef4bbd94fd2c88456a0689`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:53.914338 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-182f50f6-6072-44f8-9f4e-a112a7d98f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:54.007373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 994/1975] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:54.020646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:54.022408 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:54.028828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:54.100216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4cea7-cc47-4e13-8015-0673ab08f4a5 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:54.106661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d237816-d7b9-4400-a39e-269604d13f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:54.107265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d237816-d7b9-4400-a39e-269604d13f67 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:54.107547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d237816-d7b9-4400-a39e-269604d13f67 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:54.107820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d237816-d7b9-4400-a39e-269604d13f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:54.109862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8d237816-d7b9-4400-a39e-269604d13f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:54.168479 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d237816-d7b9-4400-a39e-269604d13f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:54.170336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d237816-d7b9-4400-a39e-269604d13f67 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:54.180288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 982/1976] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:55.590676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54114-e11d-48d7-ba2d-d39cceadb37f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:55.591161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54114-e11d-48d7-ba2d-d39cceadb37f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:55.591583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d54114-e11d-48d7-ba2d-d39cceadb37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:55.611248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-41d54114-e11d-48d7-ba2d-d39cceadb37f None None] MFA Rules not processed for user `accfa9fc356a4ccca7332118e8b9c421`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:55.612388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-41d54114-e11d-48d7-ba2d-d39cceadb37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:55.619253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 995/1977] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:01.224422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a7e42-8146-44b6-801b-ad022276aace None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:01.224892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a7e42-8146-44b6-801b-ad022276aace None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:01.225141 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a7e42-8146-44b6-801b-ad022276aace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:01.248024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-649a7e42-8146-44b6-801b-ad022276aace None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:01.248024 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-649a7e42-8146-44b6-801b-ad022276aace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:01.316270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 983/1978] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:02:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:01.372644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d54114-e11d-48d7-ba2d-d39cceadb37f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:01.375180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-41d54114-e11d-48d7-ba2d-d39cceadb37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:01.465154 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:01.505033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d54114-e11d-48d7-ba2d-d39cceadb37f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:01.510854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286547d9-c31d-4453-af79-b1592c586d37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:01.511648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286547d9-c31d-4453-af79-b1592c586d37 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:01.512022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286547d9-c31d-4453-af79-b1592c586d37 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:01.512408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286547d9-c31d-4453-af79-b1592c586d37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:01.522334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286547d9-c31d-4453-af79-b1592c586d37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:01.526455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286547d9-c31d-4453-af79-b1592c586d37 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:01.537348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 996/1979] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:02.338972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc89e3-68a4-4a37-8415-9fed342ec154 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:02.339466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc89e3-68a4-4a37-8415-9fed342ec154 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:02.339547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc89e3-68a4-4a37-8415-9fed342ec154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:02.373952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c5dc89e3-68a4-4a37-8415-9fed342ec154 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:02.376815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c5dc89e3-68a4-4a37-8415-9fed342ec154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:02.386695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 984/1980] 10.222.0.47 () {58 vars in 967 bytes} [Fri Oct 14 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:02.412637 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286547d9-c31d-4453-af79-b1592c586d37 service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:02.427611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286547d9-c31d-4453-af79-b1592c586d37 service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:02.435082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7947-d8cb-4023-8b91-a79f778c810e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:02.435980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7947-d8cb-4023-8b91-a79f778c810e service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:02.436475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7947-d8cb-4023-8b91-a79f778c810e service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:02.436931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd7947-d8cb-4023-8b91-a79f778c810e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:02.454466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd7947-d8cb-4023-8b91-a79f778c810e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:02.456544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd7947-d8cb-4023-8b91-a79f778c810e service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:02.466859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 997/1981] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:02.825778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42794e-b323-4033-a6a0-465d5105d6c4 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:02.826070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42794e-b323-4033-a6a0-465d5105d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:02.826426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42794e-b323-4033-a6a0-465d5105d6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:02.848694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5d42794e-b323-4033-a6a0-465d5105d6c4 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:02.851079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5d42794e-b323-4033-a6a0-465d5105d6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:02.864892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 985/1982] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:02.873503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7947-d8cb-4023-8b91-a79f778c810e service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:02.884993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd7947-d8cb-4023-8b91-a79f778c810e service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:02.890446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4b6b2-fff2-4526-92e2-cb899db8e0bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:02.891272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b6b2-fff2-4526-92e2-cb899db8e0bc service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:02.891794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b6b2-fff2-4526-92e2-cb899db8e0bc service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:02.892509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b6b2-fff2-4526-92e2-cb899db8e0bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:02.904249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4b6b2-fff2-4526-92e2-cb899db8e0bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:02.906221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4b6b2-fff2-4526-92e2-cb899db8e0bc service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:02.916681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 998/1983] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:03.324156 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934194-49ca-4a5f-b6b1-2232e8c21a33 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:03.324471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934194-49ca-4a5f-b6b1-2232e8c21a33 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:03.325099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934194-49ca-4a5f-b6b1-2232e8c21a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:03.347787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-61934194-49ca-4a5f-b6b1-2232e8c21a33 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:03.349834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-61934194-49ca-4a5f-b6b1-2232e8c21a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:03.358231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 986/1984] 10.222.0.47 () {58 vars in 967 bytes} [Fri Oct 14 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:03.371532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4b6b2-fff2-4526-92e2-cb899db8e0bc service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:03.382512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4b6b2-fff2-4526-92e2-cb899db8e0bc service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:03.388451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300ecff-1426-4a67-9049-d14c3b190fd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:03.389119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300ecff-1426-4a67-9049-d14c3b190fd0 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:03.389578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300ecff-1426-4a67-9049-d14c3b190fd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:03.389854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300ecff-1426-4a67-9049-d14c3b190fd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:03.401813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300ecff-1426-4a67-9049-d14c3b190fd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:03.403439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300ecff-1426-4a67-9049-d14c3b190fd0 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:03.415740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 999/1985] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:05.723718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61934194-49ca-4a5f-b6b1-2232e8c21a33 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:05.726852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-61934194-49ca-4a5f-b6b1-2232e8c21a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:05.767993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:05.813846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61934194-49ca-4a5f-b6b1-2232e8c21a33 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:05.839052 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:05.840228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.840481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.841045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] PATH_INFO: `/v3/users/fdf8adbf99e640de8419efe9d8640b47` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.842654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf8adbf99e640de8419efe9d8640b47)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:05.847741 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:05.910223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf8adbf99e640de8419efe9d8640b47'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:05.927351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf8adbf99e640de8419efe9d8640b47'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:05.928118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf8adbf99e640de8419efe9d8640b47'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:05.937983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf8adbf99e640de8419efe9d8640b47'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:05.938669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf8adbf99e640de8419efe9d8640b47'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:05.957129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 987/1986] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:05 2022] DELETE /identity/v3/users/fdf8adbf99e640de8419efe9d8640b47 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:05.961611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be53a6-5f9c-4ab5-8b5b-28422e117d1a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.962126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be53a6-5f9c-4ab5-8b5b-28422e117d1a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.962126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be53a6-5f9c-4ab5-8b5b-28422e117d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.984937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-73be53a6-5f9c-4ab5-8b5b-28422e117d1a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:05.986528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-73be53a6-5f9c-4ab5-8b5b-28422e117d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.072275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1000/1987] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:06.080303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:06.081914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.146753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a140b2b-15a2-4a64-b6e5-d530b52df63f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:06.150661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512063b-cb35-4fb8-9d9f-906428f2e11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:06.151438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512063b-cb35-4fb8-9d9f-906428f2e11f service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.151712 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512063b-cb35-4fb8-9d9f-906428f2e11f service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.151976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512063b-cb35-4fb8-9d9f-906428f2e11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.161888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512063b-cb35-4fb8-9d9f-906428f2e11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:06.163907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512063b-cb35-4fb8-9d9f-906428f2e11f service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:06.174475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 988/1988] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:06.368873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be53a6-5f9c-4ab5-8b5b-28422e117d1a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:06.370621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-73be53a6-5f9c-4ab5-8b5b-28422e117d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.383265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be53a6-5f9c-4ab5-8b5b-28422e117d1a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:06.388325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:06.389154 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.389437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.389742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] PATH_INFO: `/v3/projects/159e3573c405472baf7efac53e8a7b99` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.391116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=159e3573c405472baf7efac53e8a7b99)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:06.393078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:06.445155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159e3573c405472baf7efac53e8a7b99', 'request_id': 'req-ff21a300-40b7-46a7-a769-a41277c7d761'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.450822 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159e3573c405472baf7efac53e8a7b99', 'request_id': 'req-ff21a300-40b7-46a7-a769-a41277c7d761'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.458035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159e3573c405472baf7efac53e8a7b99', 'request_id': 'req-ff21a300-40b7-46a7-a769-a41277c7d761'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.472561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] The token cache is being invalidate because project 159e3573c405472baf7efac53e8a7b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:06.472850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.473460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.475051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1001/1989] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:06 2022] DELETE /identity/v3/projects/159e3573c405472baf7efac53e8a7b99 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:16.172826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:16.469408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:24.890667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d450a-e39d-445e-8aa3-22f50df0c686 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:24.891171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d450a-e39d-445e-8aa3-22f50df0c686 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:24.891270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d450a-e39d-445e-8aa3-22f50df0c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:24.911319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-856d450a-e39d-445e-8aa3-22f50df0c686 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:24.913069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-856d450a-e39d-445e-8aa3-22f50df0c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:24.968566 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 989/1990] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:24.985999 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:24.985999 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:25.056661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21a300-40b7-46a7-a769-a41277c7d761 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:25.061783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed891f3-b2c3-437c-af0f-cf9e31c1811c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:25.062983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed891f3-b2c3-437c-af0f-cf9e31c1811c service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:25.062983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed891f3-b2c3-437c-af0f-cf9e31c1811c service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:25.062983 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed891f3-b2c3-437c-af0f-cf9e31c1811c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:25.072713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed891f3-b2c3-437c-af0f-cf9e31c1811c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:25.074344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed891f3-b2c3-437c-af0f-cf9e31c1811c service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:25.084419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1002/1991] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:30.719679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d450a-e39d-445e-8aa3-22f50df0c686 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:30.721312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-856d450a-e39d-445e-8aa3-22f50df0c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:30.793509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d450a-e39d-445e-8aa3-22f50df0c686 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:30.797205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f191e5-8ae2-4497-b0ef-ea031213294c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:30.797842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f191e5-8ae2-4497-b0ef-ea031213294c service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:30.798122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f191e5-8ae2-4497-b0ef-ea031213294c service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:30.798388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f191e5-8ae2-4497-b0ef-ea031213294c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:30.800163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-66f191e5-8ae2-4497-b0ef-ea031213294c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:30.869903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f191e5-8ae2-4497-b0ef-ea031213294c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:30.871355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f191e5-8ae2-4497-b0ef-ea031213294c service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:30.883111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 990/1992] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:35.080359 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=32 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:39.347673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78923-700f-454f-8632-34f07f390539 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.348346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78923-700f-454f-8632-34f07f390539 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.348346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff78923-700f-454f-8632-34f07f390539 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.350411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1003/1993] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 13:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:02:39.356755 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d24be-b548-41ea-bf87-2fc4413eb3ba None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.357298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d24be-b548-41ea-bf87-2fc4413eb3ba None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.357702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d24be-b548-41ea-bf87-2fc4413eb3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.381539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-252d24be-b548-41ea-bf87-2fc4413eb3ba None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:39.382820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-252d24be-b548-41ea-bf87-2fc4413eb3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:39.445127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:39.466228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 991/1994] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:39.478662 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff78923-700f-454f-8632-34f07f390539 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:39.480475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6ff78923-700f-454f-8632-34f07f390539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:39.538210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff78923-700f-454f-8632-34f07f390539 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:39.541732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0674bf-fb21-4eb1-9f75-f06dd252ff37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3697284166c042d79d946ef469932562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:39.542339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0674bf-fb21-4eb1-9f75-f06dd252ff37 service glance] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.542616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0674bf-fb21-4eb1-9f75-f06dd252ff37 service glance] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.542887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0674bf-fb21-4eb1-9f75-f06dd252ff37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.553463 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0674bf-fb21-4eb1-9f75-f06dd252ff37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:39.555183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0674bf-fb21-4eb1-9f75-f06dd252ff37 service glance] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:39.565827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1004/1995] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:39.633502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd3008-63f3-4f99-b870-41152bedb4f1 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.633819 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd3008-63f3-4f99-b870-41152bedb4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.634095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd3008-63f3-4f99-b870-41152bedb4f1 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.635427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 992/1996] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 13:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:02:39.640097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d47a0d-f78c-45f9-9995-93ee5625884e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.640384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d47a0d-f78c-45f9-9995-93ee5625884e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.640655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d47a0d-f78c-45f9-9995-93ee5625884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.660656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-03d47a0d-f78c-45f9-9995-93ee5625884e None None] MFA Rules not processed for user `899319384b8b471f8d308f37be459c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:39.662408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-03d47a0d-f78c-45f9-9995-93ee5625884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:39.668861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1005/1997] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:39.683042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd3008-63f3-4f99-b870-41152bedb4f1 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:39.693699 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd3008-63f3-4f99-b870-41152bedb4f1 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:39.697139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64bd3-7fff-417f-9ac1-8107136376ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:39.697754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64bd3-7fff-417f-9ac1-8107136376ff service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.698034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64bd3-7fff-417f-9ac1-8107136376ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.698300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64bd3-7fff-417f-9ac1-8107136376ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.705050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b64bd3-7fff-417f-9ac1-8107136376ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:39.706475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b64bd3-7fff-417f-9ac1-8107136376ff service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:39.714989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 993/1998] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:39.796377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696fc65-548d-4788-bcbe-6248e43349e2 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.796685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696fc65-548d-4788-bcbe-6248e43349e2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.796953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696fc65-548d-4788-bcbe-6248e43349e2 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.798343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1006/1999] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 13:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:02:39.803363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c344e-de89-4dd1-8b0f-5957e6a9342b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.803669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c344e-de89-4dd1-8b0f-5957e6a9342b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.803944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c344e-de89-4dd1-8b0f-5957e6a9342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.823657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-131c344e-de89-4dd1-8b0f-5957e6a9342b None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:39.824853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-131c344e-de89-4dd1-8b0f-5957e6a9342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:39.835081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 994/2000] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:39.846113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696fc65-548d-4788-bcbe-6248e43349e2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:39.847748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2696fc65-548d-4788-bcbe-6248e43349e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:39.861669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696fc65-548d-4788-bcbe-6248e43349e2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:39.865179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac9f1c-a2d4-4178-9355-ae127d2db444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:39.865802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9f1c-a2d4-4178-9355-ae127d2db444 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:39.866073 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9f1c-a2d4-4178-9355-ae127d2db444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:39.866337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9f1c-a2d4-4178-9355-ae127d2db444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:39.876100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac9f1c-a2d4-4178-9355-ae127d2db444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:39.877584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac9f1c-a2d4-4178-9355-ae127d2db444 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:39.887914 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1007/2001] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:42.452516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aada6-ca80-4b63-96df-111941d2a9b5 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:42.453000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aada6-ca80-4b63-96df-111941d2a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:42.453099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aada6-ca80-4b63-96df-111941d2a9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:42.472525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d16aada6-ca80-4b63-96df-111941d2a9b5 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:42.473752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d16aada6-ca80-4b63-96df-111941d2a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:42.480838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 995/2002] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:42.492938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac9f1c-a2d4-4178-9355-ae127d2db444 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:42.504209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac9f1c-a2d4-4178-9355-ae127d2db444 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:42.509797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe875c-0a9e-4eed-86a2-cafab3f97d20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:42.510401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe875c-0a9e-4eed-86a2-cafab3f97d20 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:42.510677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe875c-0a9e-4eed-86a2-cafab3f97d20 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:42.510948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe875c-0a9e-4eed-86a2-cafab3f97d20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:42.518824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe875c-0a9e-4eed-86a2-cafab3f97d20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:42.520387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe875c-0a9e-4eed-86a2-cafab3f97d20 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:42.529212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1008/2003] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:52.467757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=18 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:52.525936 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=41 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:59.174457 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aada6-ca80-4b63-96df-111941d2a9b5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:59.175979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d16aada6-ca80-4b63-96df-111941d2a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:59.251437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aada6-ca80-4b63-96df-111941d2a9b5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:59.257083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:59.257737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.258145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.258415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.260285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:59.272246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:59.273904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:59.284084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 996/2004] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:08.318786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e633-fe0b-4b24-ab66-2a6c035255e8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:08.319673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e633-fe0b-4b24-ab66-2a6c035255e8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:08.320864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2e633-fe0b-4b24-ab66-2a6c035255e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:08.344087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0be2e633-fe0b-4b24-ab66-2a6c035255e8 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:08.345438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0be2e633-fe0b-4b24-ab66-2a6c035255e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:08.354358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1009/2005] 10.222.0.47 () {58 vars in 967 bytes} [Fri Oct 14 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:08.384631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:08.396631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe29cb-f128-4f7f-8633-776a73e0d306 service placement] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:08.402207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccda8a-08f0-4f75-b2c3-86316150f5d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:08.402982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccda8a-08f0-4f75-b2c3-86316150f5d6 service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:08.403334 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccda8a-08f0-4f75-b2c3-86316150f5d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:08.403677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccda8a-08f0-4f75-b2c3-86316150f5d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:08.413206 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccda8a-08f0-4f75-b2c3-86316150f5d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:08.414916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccda8a-08f0-4f75-b2c3-86316150f5d6 service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:08.435161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 997/2006] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:03:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:03:12.316027 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cbdba-d41c-4bf3-96a1-32fc004456d1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:12.316497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cbdba-d41c-4bf3-96a1-32fc004456d1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:12.317320 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cbdba-d41c-4bf3-96a1-32fc004456d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:12.336715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2b0cbdba-d41c-4bf3-96a1-32fc004456d1 None None] MFA Rules not processed for user `0bcbf6513b6a4df3b044fadfb7888d54`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:12.337932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2b0cbdba-d41c-4bf3-96a1-32fc004456d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:12.392039 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1010/2007] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:18.423644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=38 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:21.586683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ab7c-0184-4b5f-9463-4b7d73dac166 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:21.587286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ab7c-0184-4b5f-9463-4b7d73dac166 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:21.587286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ab7c-0184-4b5f-9463-4b7d73dac166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:21.606359 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-fed5ab7c-0184-4b5f-9463-4b7d73dac166 None None] MFA Rules not processed for user `60860294eb284b8aa11edd42dca4ae8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:21.607535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-fed5ab7c-0184-4b5f-9463-4b7d73dac166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:21.660789 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 998/2008] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:22.385451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=28 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:31.653844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=25 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:57.590420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bf4cb-b515-4bbd-bf97-f5261c1df3fc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:57.590952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bf4cb-b515-4bbd-bf97-f5261c1df3fc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:57.591055 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bf4cb-b515-4bbd-bf97-f5261c1df3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:57.610650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-220bf4cb-b515-4bbd-bf97-f5261c1df3fc None None] MFA Rules not processed for user `26a54235fb424dfd825b2de9f7aaa006`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:57.611861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-220bf4cb-b515-4bbd-bf97-f5261c1df3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:57.668274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1011/2009] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:03:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:58.825435 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2623eb-154e-4eef-9eea-7a14f7305164 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:58.825951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2623eb-154e-4eef-9eea-7a14f7305164 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:58.826042 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2623eb-154e-4eef-9eea-7a14f7305164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:58.848532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-cd2623eb-154e-4eef-9eea-7a14f7305164 None None] MFA Rules not processed for user `9394667740f44bcab24ee484b195fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:58.850124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cd2623eb-154e-4eef-9eea-7a14f7305164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:58.913157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 999/2010] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:03:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:07.660800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=25 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:08.905691 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=25 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:30.795835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bf4cb-b515-4bbd-bf97-f5261c1df3fc None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:30.808257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bf4cb-b515-4bbd-bf97-f5261c1df3fc None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:30.812218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:30.814928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:30.815408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:30.815814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:30.817722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:30.921579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:30.923958 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:30.937723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1012/2011] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:32.486632 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9924-8af6-4054-a296-f631603cf5f4 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:32.487508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9924-8af6-4054-a296-f631603cf5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:32.487949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c9924-8af6-4054-a296-f631603cf5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:32.507590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-6d4c9924-8af6-4054-a296-f631603cf5f4 None None] MFA Rules not processed for user `0bcbf6513b6a4df3b044fadfb7888d54`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:32.509124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6d4c9924-8af6-4054-a296-f631603cf5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:32.516348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1000/2012] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:32.805364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:32.816239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fd2cc-51e9-4f1e-9d35-332967a3e478 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:32.820565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:32.821202 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:32.821560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:32.822034 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:32.823830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:32.838467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:32.840185 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:32.854103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1013/2013] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:33.023511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c9924-8af6-4054-a296-f631603cf5f4 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:33.025467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6d4c9924-8af6-4054-a296-f631603cf5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:33.042522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c9924-8af6-4054-a296-f631603cf5f4 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:33.049374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:33.050240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.050512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.050786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] PATH_INFO: `/v3/users/60860294eb284b8aa11edd42dca4ae8d` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.051909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60860294eb284b8aa11edd42dca4ae8d)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:33.054011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:33.114007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60860294eb284b8aa11edd42dca4ae8d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.134615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60860294eb284b8aa11edd42dca4ae8d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.135460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60860294eb284b8aa11edd42dca4ae8d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.143223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60860294eb284b8aa11edd42dca4ae8d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.143879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7bdf70bb-77f3-4b60-b47e-6f03120b6e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60860294eb284b8aa11edd42dca4ae8d'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.156940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1001/2014] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:04:33 2022] DELETE /identity/v3/users/60860294eb284b8aa11edd42dca4ae8d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:04:33.383551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:33.395106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059ec96-b39b-4970-abd5-6b94a5d0f951 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:33.458411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:33.459053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.459334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.459608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] PATH_INFO: `/v3/projects/c160176d8c804b7793bae21c205c538c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.460727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c160176d8c804b7793bae21c205c538c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:33.463701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:33.516096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c160176d8c804b7793bae21c205c538c', 'request_id': 'req-0b854a56-eb9c-4a29-9980-05fb8c6edc92'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.522392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c160176d8c804b7793bae21c205c538c', 'request_id': 'req-0b854a56-eb9c-4a29-9980-05fb8c6edc92'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.530455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c160176d8c804b7793bae21c205c538c', 'request_id': 'req-0b854a56-eb9c-4a29-9980-05fb8c6edc92'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.544777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] The token cache is being invalidate because project c160176d8c804b7793bae21c205c538c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:04:33.544995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.545682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0b854a56-eb9c-4a29-9980-05fb8c6edc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:33.547195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1014/2015] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:04:33 2022] DELETE /identity/v3/projects/c160176d8c804b7793bae21c205c538c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:04:33.552216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf657e1-a451-4287-b449-f660e868236b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.552714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf657e1-a451-4287-b449-f660e868236b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.552807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf657e1-a451-4287-b449-f660e868236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.572921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ccf657e1-a451-4287-b449-f660e868236b None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:33.574060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ccf657e1-a451-4287-b449-f660e868236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:33.635327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1002/2016] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:33.643233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d4a06-b6cf-4cb2-8cb3-76bab954048f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.643511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d4a06-b6cf-4cb2-8cb3-76bab954048f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.643780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d4a06-b6cf-4cb2-8cb3-76bab954048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.665929 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3b7d4a06-b6cf-4cb2-8cb3-76bab954048f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:33.667151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3b7d4a06-b6cf-4cb2-8cb3-76bab954048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:33.676149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1015/2017] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:33.680748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf657e1-a451-4287-b449-f660e868236b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:33.691975 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf657e1-a451-4287-b449-f660e868236b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:33.697542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:33.698175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.698462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.698729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.699377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:04:33.699684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:33.701267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:33.724245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1003/2018] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:04:33.726324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d4a06-b6cf-4cb2-8cb3-76bab954048f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:33.732620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:33.737005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d4a06-b6cf-4cb2-8cb3-76bab954048f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:33.744702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503057c4-3569-4420-aaa9-b8d98dba6b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:33.745759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503057c4-3569-4420-aaa9-b8d98dba6b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.746204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503057c4-3569-4420-aaa9-b8d98dba6b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.746478 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503057c4-3569-4420-aaa9-b8d98dba6b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.747108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503057c4-3569-4420-aaa9-b8d98dba6b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:33.749017 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503057c4-3569-4420-aaa9-b8d98dba6b8e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:33.777517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1016/2019] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:04:33 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:04:33.781673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:33.791980 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c521-9ff1-4416-a657-233294c62f54 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:33.840636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:33.850951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745665d-e354-46a3-b9ea-388531560b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:33.852034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745665d-e354-46a3-b9ea-388531560b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.852627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745665d-e354-46a3-b9ea-388531560b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.853048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745665d-e354-46a3-b9ea-388531560b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.853822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745665d-e354-46a3-b9ea-388531560b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:33.856370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745665d-e354-46a3-b9ea-388531560b95 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:33.889640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1004/2020] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:04:33 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:04:33.890994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503057c4-3569-4420-aaa9-b8d98dba6b8e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:33.902508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503057c4-3569-4420-aaa9-b8d98dba6b8e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:33.908799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae524-8d70-46a5-8bed-b201d7e22e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:33.909419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae524-8d70-46a5-8bed-b201d7e22e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.909726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae524-8d70-46a5-8bed-b201d7e22e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.910193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ae524-8d70-46a5-8bed-b201d7e22e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.910923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ae524-8d70-46a5-8bed-b201d7e22e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:33.912521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ae524-8d70-46a5-8bed-b201d7e22e82 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:33.923357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1017/2021] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:04:33.927360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745665d-e354-46a3-b9ea-388531560b95 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:33.939648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745665d-e354-46a3-b9ea-388531560b95 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:33.945208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8e767-68be-48ed-bbc6-2ad8b96ad110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:33.945929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e767-68be-48ed-bbc6-2ad8b96ad110 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.946283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e767-68be-48ed-bbc6-2ad8b96ad110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.947179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8e767-68be-48ed-bbc6-2ad8b96ad110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.947910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8e767-68be-48ed-bbc6-2ad8b96ad110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:33.949571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8e767-68be-48ed-bbc6-2ad8b96ad110 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:33.965667 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1005/2022] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:04:33.966620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae524-8d70-46a5-8bed-b201d7e22e82 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:33.977044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ae524-8d70-46a5-8bed-b201d7e22e82 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:33.982015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:33.982683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:33.982963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:33.983239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] PATH_INFO: `/v3/projects/c2afb8d7c5ed4a4e91103c64dce89c7a/users/428015385b844eb69e593f72c8678f10/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:33.999537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2afb8d7c5ed4a4e91103c64dce89c7a, user_id=428015385b844eb69e593f72c8678f10, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:34.002287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:34.016127 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1018/2023] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:04:33 2022] PUT /identity/v3/projects/c2afb8d7c5ed4a4e91103c64dce89c7a/users/428015385b844eb69e593f72c8678f10/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:04:34.028103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88c30a-8a9a-472b-bb76-a81b14271fc2 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:34.028490 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88c30a-8a9a-472b-bb76-a81b14271fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:34.028646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88c30a-8a9a-472b-bb76-a81b14271fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:34.057016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8f88c30a-8a9a-472b-bb76-a81b14271fc2 None None] MFA Rules not processed for user `428015385b844eb69e593f72c8678f10`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:34.058202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8f88c30a-8a9a-472b-bb76-a81b14271fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:34.122789 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1006/2024] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:34.133742 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:34.135955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:34.191675 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cddd67-d53c-49d8-acfa-1e2a9f04ec2d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:34.195329 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44ab0c-80b3-43aa-9b27-18a9bc3c3167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:34.195926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ab0c-80b3-43aa-9b27-18a9bc3c3167 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:34.196198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ab0c-80b3-43aa-9b27-18a9bc3c3167 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:34.196490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ab0c-80b3-43aa-9b27-18a9bc3c3167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:34.204652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44ab0c-80b3-43aa-9b27-18a9bc3c3167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:34.206137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44ab0c-80b3-43aa-9b27-18a9bc3c3167 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:34.215103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1019/2025] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:35.719074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88c30a-8a9a-472b-bb76-a81b14271fc2 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:35.723625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8f88c30a-8a9a-472b-bb76-a81b14271fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:35.789067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88c30a-8a9a-472b-bb76-a81b14271fc2 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:35.792984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bac64-d1eb-47fb-814c-8130f7a5f03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:35.793789 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bac64-d1eb-47fb-814c-8130f7a5f03e service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:35.793892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bac64-d1eb-47fb-814c-8130f7a5f03e service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:35.794171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bac64-d1eb-47fb-814c-8130f7a5f03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:35.796324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4d9bac64-d1eb-47fb-814c-8130f7a5f03e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:35.886018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bac64-d1eb-47fb-814c-8130f7a5f03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:35.888646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bac64-d1eb-47fb-814c-8130f7a5f03e service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:35.903678 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1007/2026] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:42.786931 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44ab0c-80b3-43aa-9b27-18a9bc3c3167 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:42.847761 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44ab0c-80b3-43aa-9b27-18a9bc3c3167 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:42.852295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:42.852915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:42.853190 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:42.853459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] PATH_INFO: `/v3/users/428015385b844eb69e593f72c8678f10` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:42.854671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=428015385b844eb69e593f72c8678f10)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:42.856639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:42.900518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428015385b844eb69e593f72c8678f10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:42.904793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:42.913848 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428015385b844eb69e593f72c8678f10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:42.914689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428015385b844eb69e593f72c8678f10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:42.921541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428015385b844eb69e593f72c8678f10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:42.922161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428015385b844eb69e593f72c8678f10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:42.934667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1020/2027] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:04:42 2022] DELETE /identity/v3/users/428015385b844eb69e593f72c8678f10 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:04:42.939244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85313-feac-44b4-bc55-89c39367456c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:42.939692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85313-feac-44b4-bc55-89c39367456c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:42.939816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85313-feac-44b4-bc55-89c39367456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:42.947475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:42.961410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-4ed85313-feac-44b4-bc55-89c39367456c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:42.962643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4ed85313-feac-44b4-bc55-89c39367456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:43.024813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1008/2028] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:43.034293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:43.035743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:43.097710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0429b-7934-4413-be1f-75cea7fd0006 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:43.101471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3419-4815-43be-b6bd-b10c271ca091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:43.102287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3419-4815-43be-b6bd-b10c271ca091 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.103113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3419-4815-43be-b6bd-b10c271ca091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.103382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3419-4815-43be-b6bd-b10c271ca091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.113263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e3419-4815-43be-b6bd-b10c271ca091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:43.114747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e3419-4815-43be-b6bd-b10c271ca091 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:43.124565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1021/2029] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:43.493389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85313-feac-44b4-bc55-89c39367456c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:43.494842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4ed85313-feac-44b4-bc55-89c39367456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:43.511135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85313-feac-44b4-bc55-89c39367456c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:43.515971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:43.516608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.516881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.517147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] PATH_INFO: `/v3/projects/c2afb8d7c5ed4a4e91103c64dce89c7a` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.518318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2afb8d7c5ed4a4e91103c64dce89c7a)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:43.520199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:43.567242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2afb8d7c5ed4a4e91103c64dce89c7a', 'request_id': 'req-f362108e-b88e-48ab-8803-394791e18278'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:43.573603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2afb8d7c5ed4a4e91103c64dce89c7a', 'request_id': 'req-f362108e-b88e-48ab-8803-394791e18278'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:43.579686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2afb8d7c5ed4a4e91103c64dce89c7a', 'request_id': 'req-f362108e-b88e-48ab-8803-394791e18278'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:43.594766 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] The token cache is being invalidate because project c2afb8d7c5ed4a4e91103c64dce89c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:04:43.595058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:43.595673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-f362108e-b88e-48ab-8803-394791e18278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:04:43.598406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1009/2030] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:04:43 2022] DELETE /identity/v3/projects/c2afb8d7c5ed4a4e91103c64dce89c7a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:04:43.603105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f0b8d-f8ff-4cc5-8c61-0c7faa078915 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.603381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f0b8d-f8ff-4cc5-8c61-0c7faa078915 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.603754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f0b8d-f8ff-4cc5-8c61-0c7faa078915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.625362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-119f0b8d-f8ff-4cc5-8c61-0c7faa078915 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:43.626612 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-119f0b8d-f8ff-4cc5-8c61-0c7faa078915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:43.691929 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1022/2031] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:43.699697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d55c-04f5-4a83-90f0-e9984a82148e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.700013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d55c-04f5-4a83-90f0-e9984a82148e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.700290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d55c-04f5-4a83-90f0-e9984a82148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.720777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-3d10d55c-04f5-4a83-90f0-e9984a82148e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:43.722543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3d10d55c-04f5-4a83-90f0-e9984a82148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:43.731782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1010/2032] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:43.736238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f0b8d-f8ff-4cc5-8c61-0c7faa078915 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:43.746255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f0b8d-f8ff-4cc5-8c61-0c7faa078915 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:43.750832 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:43.751432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.751710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.751984 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.752633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:04:43.752940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:43.754608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:43.766410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1023/2033] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:04:43.770544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10d55c-04f5-4a83-90f0-e9984a82148e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:43.780633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10d55c-04f5-4a83-90f0-e9984a82148e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:43.785360 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b274adf-439f-4cc9-b80e-797dc547bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:43.786011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b274adf-439f-4cc9-b80e-797dc547bf7d admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.786290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b274adf-439f-4cc9-b80e-797dc547bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.786562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b274adf-439f-4cc9-b80e-797dc547bf7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.787205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b274adf-439f-4cc9-b80e-797dc547bf7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:43.789095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b274adf-439f-4cc9-b80e-797dc547bf7d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:43.816111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1011/2034] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:04:43 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:04:43.820522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:43.830286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071898b-90ae-4cd2-beb7-6976e5dedc2e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:43.886800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a5d4c-c96e-483f-8949-f691fd184b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:43.887403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5d4c-c96e-483f-8949-f691fd184b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.887696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5d4c-c96e-483f-8949-f691fd184b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.887947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a5d4c-c96e-483f-8949-f691fd184b2a admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.888599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a5d4c-c96e-483f-8949-f691fd184b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:43.890551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a5d4c-c96e-483f-8949-f691fd184b2a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:43.898397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:43.916518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1024/2035] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:04:43 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:04:43.917768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b274adf-439f-4cc9-b80e-797dc547bf7d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:43.927902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b274adf-439f-4cc9-b80e-797dc547bf7d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:43.932552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddad4c-e80c-4b25-aee2-54454cb4cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:43.933145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddad4c-e80c-4b25-aee2-54454cb4cc47 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.933427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddad4c-e80c-4b25-aee2-54454cb4cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.933734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddad4c-e80c-4b25-aee2-54454cb4cc47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.934385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddad4c-e80c-4b25-aee2-54454cb4cc47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:43.935967 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddad4c-e80c-4b25-aee2-54454cb4cc47 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:43.945944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1012/2036] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:04:43.950167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a5d4c-c96e-483f-8949-f691fd184b2a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:43.959978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a5d4c-c96e-483f-8949-f691fd184b2a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:43.965204 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7058f-ee84-4e7e-b608-377fa646e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:43.965839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7058f-ee84-4e7e-b608-377fa646e067 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:43.966120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7058f-ee84-4e7e-b608-377fa646e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:43.966395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7058f-ee84-4e7e-b608-377fa646e067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:43.967038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7058f-ee84-4e7e-b608-377fa646e067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:43.968634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7058f-ee84-4e7e-b608-377fa646e067 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:43.979259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1025/2037] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:04:43.983754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddad4c-e80c-4b25-aee2-54454cb4cc47 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:43.994439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddad4c-e80c-4b25-aee2-54454cb4cc47 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:43.999092 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89dab1-94eb-4453-80cf-29d764a4a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:43.999788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dab1-94eb-4453-80cf-29d764a4a8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.000062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dab1-94eb-4453-80cf-29d764a4a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.000336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dab1-94eb-4453-80cf-29d764a4a8e9 admin admin] PATH_INFO: `/v3/projects/1563193ced924ee78f38363adf65fe0d/users/e1653660a4cc4ccf9be5e684e27ec7ec/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.015561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89dab1-94eb-4453-80cf-29d764a4a8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1563193ced924ee78f38363adf65fe0d, user_id=e1653660a4cc4ccf9be5e684e27ec7ec, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.018218 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89dab1-94eb-4453-80cf-29d764a4a8e9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.031987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1013/2038] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:04:43 2022] PUT /identity/v3/projects/1563193ced924ee78f38363adf65fe0d/users/e1653660a4cc4ccf9be5e684e27ec7ec/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:04:44.042310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eed27-664b-4e3c-a6f8-2d30e7710e19 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.042598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eed27-664b-4e3c-a6f8-2d30e7710e19 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.042917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eed27-664b-4e3c-a6f8-2d30e7710e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.072030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cb4eed27-664b-4e3c-a6f8-2d30e7710e19 None None] MFA Rules not processed for user `e1653660a4cc4ccf9be5e684e27ec7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:44.073182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cb4eed27-664b-4e3c-a6f8-2d30e7710e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:44.136192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1026/2039] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:44.140663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89dab1-94eb-4453-80cf-29d764a4a8e9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:44.166209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:44.204038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89dab1-94eb-4453-80cf-29d764a4a8e9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:44.208685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfbf09-710a-49a4-a642-ea197a15f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:44.209318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbf09-710a-49a4-a642-ea197a15f6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.209634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbf09-710a-49a4-a642-ea197a15f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.209911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbf09-710a-49a4-a642-ea197a15f6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.210550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfbf09-710a-49a4-a642-ea197a15f6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.212447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfbf09-710a-49a4-a642-ea197a15f6a1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.238859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1014/2040] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:04:44 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:04:44.243633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eed27-664b-4e3c-a6f8-2d30e7710e19 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:44.254113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eed27-664b-4e3c-a6f8-2d30e7710e19 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:44.316990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0ace-6e38-434f-a11d-3951523275d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:44.317640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ace-6e38-434f-a11d-3951523275d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.317915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ace-6e38-434f-a11d-3951523275d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.318182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0ace-6e38-434f-a11d-3951523275d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.318810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d0ace-6e38-434f-a11d-3951523275d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.320712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d0ace-6e38-434f-a11d-3951523275d8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.342448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1027/2041] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:04:44 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:04:44.346819 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfbf09-710a-49a4-a642-ea197a15f6a1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:44.357985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfbf09-710a-49a4-a642-ea197a15f6a1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:44.363289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6a17-6637-49c2-a948-389b17473596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:44.363900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6a17-6637-49c2-a948-389b17473596 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.364181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6a17-6637-49c2-a948-389b17473596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.364457 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e6a17-6637-49c2-a948-389b17473596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.365114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e6a17-6637-49c2-a948-389b17473596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.366761 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e6a17-6637-49c2-a948-389b17473596 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.378563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1015/2042] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:04:44.382769 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0ace-6e38-434f-a11d-3951523275d8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:44.392770 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0ace-6e38-434f-a11d-3951523275d8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:44.398103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de903629-12e0-4e69-9e13-38670cdf3881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:44.398756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903629-12e0-4e69-9e13-38670cdf3881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.399031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903629-12e0-4e69-9e13-38670cdf3881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.399807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de903629-12e0-4e69-9e13-38670cdf3881 admin admin] PATH_INFO: `/v3/projects/652602e514f04251b666f78c0ae99bdb/users/90acc0b754994efb8454144115582583/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.415417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903629-12e0-4e69-9e13-38670cdf3881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652602e514f04251b666f78c0ae99bdb, user_id=90acc0b754994efb8454144115582583, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.418117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de903629-12e0-4e69-9e13-38670cdf3881 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.431982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1028/2043] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:04:44 2022] PUT /identity/v3/projects/652602e514f04251b666f78c0ae99bdb/users/90acc0b754994efb8454144115582583/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:04:44.435794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6a17-6637-49c2-a948-389b17473596 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:44.446582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e6a17-6637-49c2-a948-389b17473596 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:44.512799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffd7c1-3825-4012-9e0f-8ba226be251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:44.513410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffd7c1-3825-4012-9e0f-8ba226be251f admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.513716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffd7c1-3825-4012-9e0f-8ba226be251f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.513987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffd7c1-3825-4012-9e0f-8ba226be251f admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.514635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffd7c1-3825-4012-9e0f-8ba226be251f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.516217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffd7c1-3825-4012-9e0f-8ba226be251f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.529822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1016/2044] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:04:44.531111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de903629-12e0-4e69-9e13-38670cdf3881 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:44.542237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de903629-12e0-4e69-9e13-38670cdf3881 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:44.547007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:44.547738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.548021 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.548297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] PATH_INFO: `/v3/projects/652602e514f04251b666f78c0ae99bdb/users/90acc0b754994efb8454144115582583/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.550565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] RBAC: Authorizing `identity:create_grant(project_id=652602e514f04251b666f78c0ae99bdb, user_id=90acc0b754994efb8454144115582583, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.553214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.575572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1029/2045] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:04:44 2022] PUT /identity/v3/projects/652602e514f04251b666f78c0ae99bdb/users/90acc0b754994efb8454144115582583/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:04:44.577623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c98f-6ee2-4adf-9370-af117cb58ec5 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.578083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c98f-6ee2-4adf-9370-af117cb58ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.578367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c98f-6ee2-4adf-9370-af117cb58ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.608687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-42f9c98f-6ee2-4adf-9370-af117cb58ec5 None None] MFA Rules not processed for user `90acc0b754994efb8454144115582583`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:44.610320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-42f9c98f-6ee2-4adf-9370-af117cb58ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:44.694319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1017/2046] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:44.705658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:44.707496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:44.730859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:44.769673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2be198-2ac4-4a2d-ab94-d63f874b80da admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:44.773525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:44.774183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.774461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.774730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.784849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.786348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.797389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1030/2047] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:44.879128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c98f-6ee2-4adf-9370-af117cb58ec5 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:44.889122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c98f-6ee2-4adf-9370-af117cb58ec5 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:44.904583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:44.905311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:44.905684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:44.906018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:44.920136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:44.967658 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:44.969275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:44.983451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1018/2048] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:50.855437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:50.857123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:50.869063 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb271e-f58d-41ce-90d2-ce1d14606ec3 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:50.872921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d42daa-2d21-4fdd-a70e-3f59d817028d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:50.873550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42daa-2d21-4fdd-a70e-3f59d817028d service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:50.873833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42daa-2d21-4fdd-a70e-3f59d817028d service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:50.874103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d42daa-2d21-4fdd-a70e-3f59d817028d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:50.875840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-02d42daa-2d21-4fdd-a70e-3f59d817028d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:50.937106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d42daa-2d21-4fdd-a70e-3f59d817028d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:50.938600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d42daa-2d21-4fdd-a70e-3f59d817028d service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:50.948544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1031/2049] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:54.984977 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=20 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:56.586848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:56.588855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:56.648452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6bcc3-5571-40d4-aa68-1f0b32af1969 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:56.653097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee438c3-ef8e-47a3-a76e-a2c56b4e408d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:56.653799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee438c3-ef8e-47a3-a76e-a2c56b4e408d service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:56.654072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee438c3-ef8e-47a3-a76e-a2c56b4e408d service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:56.654339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee438c3-ef8e-47a3-a76e-a2c56b4e408d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:56.656072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0ee438c3-ef8e-47a3-a76e-a2c56b4e408d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:56.665896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee438c3-ef8e-47a3-a76e-a2c56b4e408d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:56.667340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee438c3-ef8e-47a3-a76e-a2c56b4e408d service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:56.675531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1019/2050] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:56.802658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a324d07-2ed5-4bbb-9ce5-1299708267f4 None None] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:56.803246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a324d07-2ed5-4bbb-9ce5-1299708267f4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:56.803246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a324d07-2ed5-4bbb-9ce5-1299708267f4 None None] PATH_INFO: `/` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:56.804824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1032/2051] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 13:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:04:56.812370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999662cb-838d-473c-8bad-6a76719302d3 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:56.812952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999662cb-838d-473c-8bad-6a76719302d3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:56.813226 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999662cb-838d-473c-8bad-6a76719302d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:56.845148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-999662cb-838d-473c-8bad-6a76719302d3 None None] MFA Rules not processed for user `899319384b8b471f8d308f37be459c59`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:56.846466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-999662cb-838d-473c-8bad-6a76719302d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:56.860254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1020/2052] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 13:04:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:56.869103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a324d07-2ed5-4bbb-9ce5-1299708267f4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:56.871089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0a324d07-2ed5-4bbb-9ce5-1299708267f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:56.890707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a324d07-2ed5-4bbb-9ce5-1299708267f4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:56.896474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d48bbb-c7fd-46f2-952d-5de91439dc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:56.897379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d48bbb-c7fd-46f2-952d-5de91439dc15 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:56.898005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d48bbb-c7fd-46f2-952d-5de91439dc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:56.898575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d48bbb-c7fd-46f2-952d-5de91439dc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:56.907345 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d48bbb-c7fd-46f2-952d-5de91439dc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:56.908927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d48bbb-c7fd-46f2-952d-5de91439dc15 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:56.919012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1033/2053] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:57.015769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29299-a503-4745-bcb6-0e39fd01e786 None None] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:57.016055 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29299-a503-4745-bcb6-0e39fd01e786 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:57.016342 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f29299-a503-4745-bcb6-0e39fd01e786 None None] PATH_INFO: `/` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:57.017729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1021/2054] 10.222.0.47 () {54 vars in 921 bytes} [Fri Oct 14 13:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:04:57.022569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233697a-732d-4f9c-99d8-aaf696e99a53 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:57.022859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233697a-732d-4f9c-99d8-aaf696e99a53 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:57.023137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233697a-732d-4f9c-99d8-aaf696e99a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:57.043690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7233697a-732d-4f9c-99d8-aaf696e99a53 None None] MFA Rules not processed for user `d360b800645041cf8caa43dcc0116761`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:57.044885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7233697a-732d-4f9c-99d8-aaf696e99a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:57.113260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1034/2055] 10.222.0.47 () {58 vars in 1018 bytes} [Fri Oct 14 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:57.124188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f29299-a503-4745-bcb6-0e39fd01e786 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:57.135322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f29299-a503-4745-bcb6-0e39fd01e786 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:57.138998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49262e8f-af48-4a31-a7b6-81c91bbbae75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:57.139603 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49262e8f-af48-4a31-a7b6-81c91bbbae75 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:57.139881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49262e8f-af48-4a31-a7b6-81c91bbbae75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:57.140153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49262e8f-af48-4a31-a7b6-81c91bbbae75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:57.150988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49262e8f-af48-4a31-a7b6-81c91bbbae75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:57.152474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49262e8f-af48-4a31-a7b6-81c91bbbae75 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:57.163584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1022/2056] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:57.229344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233697a-732d-4f9c-99d8-aaf696e99a53 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:57.230770 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7233697a-732d-4f9c-99d8-aaf696e99a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:57.276252 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:57.303159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233697a-732d-4f9c-99d8-aaf696e99a53 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:57.308421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23a3f-4a93-4e24-91c1-648dc1ee98ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:57.309032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23a3f-4a93-4e24-91c1-648dc1ee98ad service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:57.309308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23a3f-4a93-4e24-91c1-648dc1ee98ad service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:57.309613 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23a3f-4a93-4e24-91c1-648dc1ee98ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:57.311538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5ee23a3f-4a93-4e24-91c1-648dc1ee98ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:57.324406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23a3f-4a93-4e24-91c1-648dc1ee98ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:57.326402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23a3f-4a93-4e24-91c1-648dc1ee98ad service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:57.336956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1035/2057] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:04.909008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49262e8f-af48-4a31-a7b6-81c91bbbae75 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:04.918432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49262e8f-af48-4a31-a7b6-81c91bbbae75 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:04.922135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:04.922804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:04.923147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:04.923484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:04.925517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:04.935470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:04.936926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:04.944997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1023/2058] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:07.333081 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=14 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:14.941315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=41 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:17.579721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84864d3-d50e-4f5d-9388-ab340a6d3ae9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:17.580206 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84864d3-d50e-4f5d-9388-ab340a6d3ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:17.580337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84864d3-d50e-4f5d-9388-ab340a6d3ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:17.607498 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f84864d3-d50e-4f5d-9388-ab340a6d3ae9 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:17.608741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f84864d3-d50e-4f5d-9388-ab340a6d3ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:17.682340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1036/2059] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:17.780208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:17.781870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:17.864393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b9183-e8ae-4436-a8d4-93ca4671869a service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:17.871605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b28ba7-c928-4b80-b42c-6daea269e24f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:17.872228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b28ba7-c928-4b80-b42c-6daea269e24f service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:17.872500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b28ba7-c928-4b80-b42c-6daea269e24f service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:17.873046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b28ba7-c928-4b80-b42c-6daea269e24f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:17.886333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b28ba7-c928-4b80-b42c-6daea269e24f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:17.888091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b28ba7-c928-4b80-b42c-6daea269e24f service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:17.899777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1024/2060] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:05:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:18.048263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84864d3-d50e-4f5d-9388-ab340a6d3ae9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:18.050068 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f84864d3-d50e-4f5d-9388-ab340a6d3ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:18.067944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84864d3-d50e-4f5d-9388-ab340a6d3ae9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:18.074404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:18.075214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:18.075555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:18.075894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:18.077741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:18.093199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:18.095729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:18.120768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1037/2061] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:18.766950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b28ba7-c928-4b80-b42c-6daea269e24f service swift] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:18.797722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b28ba7-c928-4b80-b42c-6daea269e24f service swift] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:18.824418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13148-fc67-473c-bac5-919f8137c871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:18.825353 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13148-fc67-473c-bac5-919f8137c871 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:18.825874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13148-fc67-473c-bac5-919f8137c871 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:18.827578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13148-fc67-473c-bac5-919f8137c871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:18.831069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bcc13148-fc67-473c-bac5-919f8137c871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:18.847664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13148-fc67-473c-bac5-919f8137c871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:18.849857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13148-fc67-473c-bac5-919f8137c871 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:18.885679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1025/2062] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:25.661304 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:25.746568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef0e0a-739a-4f0f-8f88-8d23e1e0f0de service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:25.751649 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:25.752399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:25.752925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:25.753105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] PATH_INFO: `/v3/users/e1653660a4cc4ccf9be5e684e27ec7ec` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:25.754629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1653660a4cc4ccf9be5e684e27ec7ec)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:25.756872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:25.841167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1653660a4cc4ccf9be5e684e27ec7ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:25.857460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1653660a4cc4ccf9be5e684e27ec7ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:25.858200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1653660a4cc4ccf9be5e684e27ec7ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:25.868025 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1653660a4cc4ccf9be5e684e27ec7ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:25.869314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1653660a4cc4ccf9be5e684e27ec7ec'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:25.884083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1038/2063] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:25 2022] DELETE /identity/v3/users/e1653660a4cc4ccf9be5e684e27ec7ec => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:25.888576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973473e3-0cb9-4aef-9d95-7185e7fac727 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:25.889048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973473e3-0cb9-4aef-9d95-7185e7fac727 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:25.889140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973473e3-0cb9-4aef-9d95-7185e7fac727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:25.915584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-973473e3-0cb9-4aef-9d95-7185e7fac727 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:25.916860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-973473e3-0cb9-4aef-9d95-7185e7fac727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:25.998585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1026/2064] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:26.008917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:26.010605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:26.029318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:26.091362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec474be-6a4f-4f49-9c18-55f5ad060762 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:26.095950 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfbff7-51b5-4c65-b151-801a3aab8bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:26.096503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbff7-51b5-4c65-b151-801a3aab8bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:26.096996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbff7-51b5-4c65-b151-801a3aab8bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:26.097334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbff7-51b5-4c65-b151-801a3aab8bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:26.111567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfbff7-51b5-4c65-b151-801a3aab8bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:26.113702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfbff7-51b5-4c65-b151-801a3aab8bb5 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:26.127099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1039/2065] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:26.552854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973473e3-0cb9-4aef-9d95-7185e7fac727 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:26.554638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-973473e3-0cb9-4aef-9d95-7185e7fac727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:26.574263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973473e3-0cb9-4aef-9d95-7185e7fac727 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:26.582138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:26.582787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:26.583063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:26.583496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] PATH_INFO: `/v3/projects/1563193ced924ee78f38363adf65fe0d` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:26.584797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1563193ced924ee78f38363adf65fe0d)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:26.587928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:26.653252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1563193ced924ee78f38363adf65fe0d', 'request_id': 'req-21d6db80-c503-4698-8df0-9c053f8a307e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.660397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1563193ced924ee78f38363adf65fe0d', 'request_id': 'req-21d6db80-c503-4698-8df0-9c053f8a307e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.667449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1563193ced924ee78f38363adf65fe0d', 'request_id': 'req-21d6db80-c503-4698-8df0-9c053f8a307e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.678390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:26.683165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] The token cache is being invalidate because project 1563193ced924ee78f38363adf65fe0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:26.683850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.684620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.689330 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1027/2066] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:26 2022] DELETE /identity/v3/projects/1563193ced924ee78f38363adf65fe0d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:26.690492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfbff7-51b5-4c65-b151-801a3aab8bb5 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:26.700789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfbff7-51b5-4c65-b151-801a3aab8bb5 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:26.772076 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:26.772722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:26.773284 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:26.773665 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] PATH_INFO: `/v3/users/90acc0b754994efb8454144115582583` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:26.774849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90acc0b754994efb8454144115582583)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:26.776782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:26.830915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90acc0b754994efb8454144115582583'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.847193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90acc0b754994efb8454144115582583'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.847944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90acc0b754994efb8454144115582583'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.857092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90acc0b754994efb8454144115582583'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.857906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90acc0b754994efb8454144115582583'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:26.873783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1040/2067] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:26 2022] DELETE /identity/v3/users/90acc0b754994efb8454144115582583 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:27.060656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:27.063198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:27.157434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6db80-c503-4698-8df0-9c053f8a307e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:27.229366 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fe4f-6ba3-40c5-b683-9a30a10e93a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:27.229543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fe4f-6ba3-40c5-b683-9a30a10e93a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:27.229832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fe4f-6ba3-40c5-b683-9a30a10e93a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:27.230878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fe4f-6ba3-40c5-b683-9a30a10e93a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:27.231420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:27.232864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:27.234985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b487fe4f-6ba3-40c5-b683-9a30a10e93a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:27.281806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:27.316057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fe4f-6ba3-40c5-b683-9a30a10e93a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:27.317999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fe4f-6ba3-40c5-b683-9a30a10e93a1 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:27.329982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1028/2068] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:27.351463 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915311b-2d0a-45a8-911b-5b5f035d5d91 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:27.364020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:27.365925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:27.366205 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:27.366480 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] PATH_INFO: `/v3/projects/652602e514f04251b666f78c0ae99bdb` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:27.373029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652602e514f04251b666f78c0ae99bdb)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:27.375078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:27.487434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652602e514f04251b666f78c0ae99bdb', 'request_id': 'req-d537d69a-d194-4707-89e0-c9133503aec8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:27.496093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652602e514f04251b666f78c0ae99bdb', 'request_id': 'req-d537d69a-d194-4707-89e0-c9133503aec8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:27.503947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652602e514f04251b666f78c0ae99bdb', 'request_id': 'req-d537d69a-d194-4707-89e0-c9133503aec8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:27.524243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] The token cache is being invalidate because project 652602e514f04251b666f78c0ae99bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:27.538138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:27.543288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-d537d69a-d194-4707-89e0-c9133503aec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:27.547078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1041/2069] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:27 2022] DELETE /identity/v3/projects/652602e514f04251b666f78c0ae99bdb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:27.551725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7092-ce6c-4150-9011-5ecd33f359fd None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:27.552418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7092-ce6c-4150-9011-5ecd33f359fd None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:27.552708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7092-ce6c-4150-9011-5ecd33f359fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:27.593121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c3cb7092-ce6c-4150-9011-5ecd33f359fd None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:27.594552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c3cb7092-ce6c-4150-9011-5ecd33f359fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:27.674801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1029/2070] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:05:27.682785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ced48-ab9a-4bc9-8b22-4448e1c2e590 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:27.683116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ced48-ab9a-4bc9-8b22-4448e1c2e590 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:27.683390 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ced48-ab9a-4bc9-8b22-4448e1c2e590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:27.707975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bc4ced48-ab9a-4bc9-8b22-4448e1c2e590 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:27.709234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bc4ced48-ab9a-4bc9-8b22-4448e1c2e590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:27.722781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1042/2071] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:27.726944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb7092-ce6c-4150-9011-5ecd33f359fd None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:27.737986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb7092-ce6c-4150-9011-5ecd33f359fd None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:27.744373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:27.744982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:27.745309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:27.745622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:27.747057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:05:27.747057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:27.748349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:27.750315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:27.764031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1030/2072] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:05:27.768500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ced48-ab9a-4bc9-8b22-4448e1c2e590 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:27.782124 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ced48-ab9a-4bc9-8b22-4448e1c2e590 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:27.788512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0b4d6-a00d-4f17-9f53-81b9b1e01031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:27.789907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b4d6-a00d-4f17-9f53-81b9b1e01031 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:27.790247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b4d6-a00d-4f17-9f53-81b9b1e01031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:27.790600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0b4d6-a00d-4f17-9f53-81b9b1e01031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:27.791313 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0b4d6-a00d-4f17-9f53-81b9b1e01031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:27.793317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0b4d6-a00d-4f17-9f53-81b9b1e01031 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:27.825104 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1043/2073] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:27 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:27.828952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:27.839782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce7726-25e4-4399-80a9-3e436467812f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:27.927496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9afa17-134f-464f-b34e-a0cc1a090835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:27.928370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afa17-134f-464f-b34e-a0cc1a090835 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:27.928525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afa17-134f-464f-b34e-a0cc1a090835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:27.928800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9afa17-134f-464f-b34e-a0cc1a090835 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:27.929470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9afa17-134f-464f-b34e-a0cc1a090835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:27.932085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9afa17-134f-464f-b34e-a0cc1a090835 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:27.960252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1031/2074] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:27 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:27.964670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0b4d6-a00d-4f17-9f53-81b9b1e01031 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:27.992871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0b4d6-a00d-4f17-9f53-81b9b1e01031 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:27.998188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49299932-7031-4b48-bdfa-23e6e4570c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:27.999080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299932-7031-4b48-bdfa-23e6e4570c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:27.999548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299932-7031-4b48-bdfa-23e6e4570c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.000005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299932-7031-4b48-bdfa-23e6e4570c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.000957 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49299932-7031-4b48-bdfa-23e6e4570c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.002935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49299932-7031-4b48-bdfa-23e6e4570c41 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.018375 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1044/2075] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:05:28.020035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9afa17-134f-464f-b34e-a0cc1a090835 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.034023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9afa17-134f-464f-b34e-a0cc1a090835 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.045287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c47650-c98a-4c67-9af9-7f1bfe60638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.046098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47650-c98a-4c67-9af9-7f1bfe60638e admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.046647 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47650-c98a-4c67-9af9-7f1bfe60638e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.046813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c47650-c98a-4c67-9af9-7f1bfe60638e admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.047487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c47650-c98a-4c67-9af9-7f1bfe60638e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.049193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c47650-c98a-4c67-9af9-7f1bfe60638e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.068656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1032/2076] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:28.071109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49299932-7031-4b48-bdfa-23e6e4570c41 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.082857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49299932-7031-4b48-bdfa-23e6e4570c41 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.099268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c96384-0faa-4841-9672-ab637e7379f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.100278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96384-0faa-4841-9672-ab637e7379f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.100564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96384-0faa-4841-9672-ab637e7379f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.100917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c96384-0faa-4841-9672-ab637e7379f4 admin admin] PATH_INFO: `/v3/projects/9935a446b9c34f33884508f96d0f2fc7/users/a7dd329e552f445ca2b4ba36715f44e1/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.118932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c96384-0faa-4841-9672-ab637e7379f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9935a446b9c34f33884508f96d0f2fc7, user_id=a7dd329e552f445ca2b4ba36715f44e1, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.121639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c96384-0faa-4841-9672-ab637e7379f4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.137603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1045/2077] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:28 2022] PUT /identity/v3/projects/9935a446b9c34f33884508f96d0f2fc7/users/a7dd329e552f445ca2b4ba36715f44e1/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:28.147979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecb3ed-7e73-4ad5-9008-7cf5bf04c87c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.148279 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecb3ed-7e73-4ad5-9008-7cf5bf04c87c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.148499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecb3ed-7e73-4ad5-9008-7cf5bf04c87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.182566 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-7cecb3ed-7e73-4ad5-9008-7cf5bf04c87c None None] MFA Rules not processed for user `a7dd329e552f445ca2b4ba36715f44e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:28.184583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7cecb3ed-7e73-4ad5-9008-7cf5bf04c87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:28.262590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1033/2078] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:28.267372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c96384-0faa-4841-9672-ab637e7379f4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.332106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c96384-0faa-4841-9672-ab637e7379f4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.337404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc12fe4-1cd9-4978-9056-e71b0f77f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.338110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc12fe4-1cd9-4978-9056-e71b0f77f593 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.338459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc12fe4-1cd9-4978-9056-e71b0f77f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.338800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc12fe4-1cd9-4978-9056-e71b0f77f593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.339495 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc12fe4-1cd9-4978-9056-e71b0f77f593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.341551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc12fe4-1cd9-4978-9056-e71b0f77f593 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.346212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:28.372892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1046/2079] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:28 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:05:28.377410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecb3ed-7e73-4ad5-9008-7cf5bf04c87c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.389094 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecb3ed-7e73-4ad5-9008-7cf5bf04c87c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.454645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14892385-374d-4b6e-8b7b-689dd52dabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.455270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14892385-374d-4b6e-8b7b-689dd52dabd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.455549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14892385-374d-4b6e-8b7b-689dd52dabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.455821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14892385-374d-4b6e-8b7b-689dd52dabd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.456484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14892385-374d-4b6e-8b7b-689dd52dabd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.458509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14892385-374d-4b6e-8b7b-689dd52dabd2 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.469090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:28.485802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1034/2080] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:28 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:05:28.489789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc12fe4-1cd9-4978-9056-e71b0f77f593 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.501162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc12fe4-1cd9-4978-9056-e71b0f77f593 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.506537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff78f36-3f7e-4a9d-a216-c192a888a3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.506725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78f36-3f7e-4a9d-a216-c192a888a3db admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.506959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78f36-3f7e-4a9d-a216-c192a888a3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.507231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78f36-3f7e-4a9d-a216-c192a888a3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.508084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff78f36-3f7e-4a9d-a216-c192a888a3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.509759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff78f36-3f7e-4a9d-a216-c192a888a3db admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.525382 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1047/2081] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:28.527106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14892385-374d-4b6e-8b7b-689dd52dabd2 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.540115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14892385-374d-4b6e-8b7b-689dd52dabd2 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.547840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c75e-a21a-4b79-983e-f6f80f206938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.548715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c75e-a21a-4b79-983e-f6f80f206938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.549062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c75e-a21a-4b79-983e-f6f80f206938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.549429 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86c75e-a21a-4b79-983e-f6f80f206938 admin admin] PATH_INFO: `/v3/projects/82101fb3ea184fc29abf4911f326f239/users/e6137135bed7446b9da9bd352052f623/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.568844 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86c75e-a21a-4b79-983e-f6f80f206938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82101fb3ea184fc29abf4911f326f239, user_id=e6137135bed7446b9da9bd352052f623, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.571724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86c75e-a21a-4b79-983e-f6f80f206938 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.590821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1035/2082] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:28 2022] PUT /identity/v3/projects/82101fb3ea184fc29abf4911f326f239/users/e6137135bed7446b9da9bd352052f623/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:28.594573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff78f36-3f7e-4a9d-a216-c192a888a3db admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.607024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff78f36-3f7e-4a9d-a216-c192a888a3db admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.684235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e5955-d931-4b22-8427-9dfd3e73bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.684770 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5955-d931-4b22-8427-9dfd3e73bf3c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.685098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5955-d931-4b22-8427-9dfd3e73bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.685375 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5955-d931-4b22-8427-9dfd3e73bf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.686130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e5955-d931-4b22-8427-9dfd3e73bf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.687740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e5955-d931-4b22-8427-9dfd3e73bf3c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.701732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1048/2083] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:28.703921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c75e-a21a-4b79-983e-f6f80f206938 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.715399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86c75e-a21a-4b79-983e-f6f80f206938 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.720485 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.721256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.721671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.722056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] PATH_INFO: `/v3/projects/82101fb3ea184fc29abf4911f326f239/users/e6137135bed7446b9da9bd352052f623/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.725628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82101fb3ea184fc29abf4911f326f239, user_id=e6137135bed7446b9da9bd352052f623, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.731413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.752618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1036/2084] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:28 2022] PUT /identity/v3/projects/82101fb3ea184fc29abf4911f326f239/users/e6137135bed7446b9da9bd352052f623/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:28.756032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5668b-45b5-487a-b3a7-168abe02cf99 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.756540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5668b-45b5-487a-b3a7-168abe02cf99 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.756691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5668b-45b5-487a-b3a7-168abe02cf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.787376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-25c5668b-45b5-487a-b3a7-168abe02cf99 None None] MFA Rules not processed for user `e6137135bed7446b9da9bd352052f623`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:28.788598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-25c5668b-45b5-487a-b3a7-168abe02cf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:28.870377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1049/2085] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:28.882499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:28.884659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:28.955214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58888cd0-d433-4137-adb9-3d685fe1e486 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:28.959320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2299b27-0195-4bbf-a1e7-48aa2bdc0f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:28.960099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2299b27-0195-4bbf-a1e7-48aa2bdc0f0f service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:28.960487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2299b27-0195-4bbf-a1e7-48aa2bdc0f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:28.960890 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2299b27-0195-4bbf-a1e7-48aa2bdc0f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:28.973075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2299b27-0195-4bbf-a1e7-48aa2bdc0f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:28.979217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2299b27-0195-4bbf-a1e7-48aa2bdc0f0f service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:28.989737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1037/2086] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:29.475118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5668b-45b5-487a-b3a7-168abe02cf99 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:29.561462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:29.569757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5668b-45b5-487a-b3a7-168abe02cf99 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:29.578300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:29.579040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:29.579460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:29.579736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] PATH_INFO: `/v3/users/a7dd329e552f445ca2b4ba36715f44e1` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:29.581211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7dd329e552f445ca2b4ba36715f44e1)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:29.583332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:29.645354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7dd329e552f445ca2b4ba36715f44e1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:29.660231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7dd329e552f445ca2b4ba36715f44e1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:29.661033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7dd329e552f445ca2b4ba36715f44e1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:29.671133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7dd329e552f445ca2b4ba36715f44e1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:29.672344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7dd329e552f445ca2b4ba36715f44e1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:29.688450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1050/2087] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:29 2022] DELETE /identity/v3/users/a7dd329e552f445ca2b4ba36715f44e1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:29.694066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9796-374f-4610-b74b-3ace2a95f331 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:29.694651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9796-374f-4610-b74b-3ace2a95f331 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:29.694813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f9796-374f-4610-b74b-3ace2a95f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:29.729463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d89f9796-374f-4610-b74b-3ace2a95f331 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:29.732786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d89f9796-374f-4610-b74b-3ace2a95f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:29.829915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1038/2088] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:29.839921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:29.841452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:29.905304 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f17ef-877f-4185-bc38-c52fe7e70e9d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:29.909836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca588-fbfc-4eef-9751-682f360f1cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:29.910974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca588-fbfc-4eef-9751-682f360f1cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:29.911466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca588-fbfc-4eef-9751-682f360f1cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:29.911935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca588-fbfc-4eef-9751-682f360f1cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:29.927310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca588-fbfc-4eef-9751-682f360f1cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:29.928678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ca588-fbfc-4eef-9751-682f360f1cb5 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:29.939238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1051/2089] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:30.484008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f9796-374f-4610-b74b-3ace2a95f331 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:30.496562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d89f9796-374f-4610-b74b-3ace2a95f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:30.512108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f9796-374f-4610-b74b-3ace2a95f331 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:30.516954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:30.517637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:30.517919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:30.518190 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] PATH_INFO: `/v3/projects/9935a446b9c34f33884508f96d0f2fc7` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:30.519326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9935a446b9c34f33884508f96d0f2fc7)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:30.521552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:30.577140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9935a446b9c34f33884508f96d0f2fc7', 'request_id': 'req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.579227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:30.584128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9935a446b9c34f33884508f96d0f2fc7', 'request_id': 'req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.592911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9935a446b9c34f33884508f96d0f2fc7', 'request_id': 'req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.610420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] The token cache is being invalidate because project 9935a446b9c34f33884508f96d0f2fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:30.610522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.611195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.616381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1039/2090] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:30 2022] DELETE /identity/v3/projects/9935a446b9c34f33884508f96d0f2fc7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:30.617728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca588-fbfc-4eef-9751-682f360f1cb5 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:30.629403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca588-fbfc-4eef-9751-682f360f1cb5 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:30.697286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:30.697972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:30.698252 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:30.698524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] PATH_INFO: `/v3/users/e6137135bed7446b9da9bd352052f623` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:30.699663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6137135bed7446b9da9bd352052f623)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:30.701632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:30.727746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:30.761132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6137135bed7446b9da9bd352052f623'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.774344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6137135bed7446b9da9bd352052f623'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.775126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6137135bed7446b9da9bd352052f623'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.783685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6137135bed7446b9da9bd352052f623'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.784533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-37d4450a-6895-47c0-9b21-1900bd9d020b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6137135bed7446b9da9bd352052f623'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:30.799274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1052/2091] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:30 2022] DELETE /identity/v3/users/e6137135bed7446b9da9bd352052f623 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:31.116623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.118770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:31.135470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe0f6e-26eb-475c-a82b-a85a8bb67dc3 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.219030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.219841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.220223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.220729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] PATH_INFO: `/v3/projects/82101fb3ea184fc29abf4911f326f239` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.222053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=82101fb3ea184fc29abf4911f326f239)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:31.224104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:31.282926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82101fb3ea184fc29abf4911f326f239', 'request_id': 'req-d24f6f05-8760-4a6b-9209-5077658c19bb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.290185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82101fb3ea184fc29abf4911f326f239', 'request_id': 'req-d24f6f05-8760-4a6b-9209-5077658c19bb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.297383 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82101fb3ea184fc29abf4911f326f239', 'request_id': 'req-d24f6f05-8760-4a6b-9209-5077658c19bb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.313013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] The token cache is being invalidate because project 82101fb3ea184fc29abf4911f326f239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:31.313390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.314280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d24f6f05-8760-4a6b-9209-5077658c19bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.315839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1040/2092] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:31 2022] DELETE /identity/v3/projects/82101fb3ea184fc29abf4911f326f239 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:31.320987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fbdf8-e67a-4957-b403-c50cb6e1666f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.321550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fbdf8-e67a-4957-b403-c50cb6e1666f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.321764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fbdf8-e67a-4957-b403-c50cb6e1666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.346447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-3a1fbdf8-e67a-4957-b403-c50cb6e1666f None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:31.349763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3a1fbdf8-e67a-4957-b403-c50cb6e1666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:31.429546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1053/2093] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:31.439709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e910-f38c-4f0e-8c63-c7c07b4c6038 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.439996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e910-f38c-4f0e-8c63-c7c07b4c6038 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.440269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e910-f38c-4f0e-8c63-c7c07b4c6038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.460573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-6699e910-f38c-4f0e-8c63-c7c07b4c6038 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:31.461943 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6699e910-f38c-4f0e-8c63-c7c07b4c6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:31.477096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1041/2094] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:31.480690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fbdf8-e67a-4957-b403-c50cb6e1666f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.489972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699e910-f38c-4f0e-8c63-c7c07b4c6038 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.491459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6699e910-f38c-4f0e-8c63-c7c07b4c6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:31.493322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fbdf8-e67a-4957-b403-c50cb6e1666f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.498828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.499444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.499719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.500159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.501371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:05:31.501718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:31.503938 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:31.519593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1054/2095] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:05:31.524360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.535120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8b03a-6b16-4e5c-8f9b-70eb4f6740d3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.541257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.542246 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.542560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.542834 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.543730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:31.546388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:31.608495 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1055/2096] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:31 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:31.609680 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.615203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:31.615415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699e910-f38c-4f0e-8c63-c7c07b4c6038 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.628319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:31.703506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.704115 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.704399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.704690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.706597 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:31.706836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073d01c-aeba-43ee-b830-f67fc8544cff admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.724784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.724784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.724784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.724784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] PATH_INFO: `/v3/users/9394667740f44bcab24ee484b195fe96` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.725262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9394667740f44bcab24ee484b195fe96)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:31.725262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:31.725455 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:31.725455 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:31.733280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1042/2097] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:31.733932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.734335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:31.745568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f241c-b086-4c39-a37f-252e9956fe24 service placement] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.751244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18ca1d-2282-4f9a-86e0-bd979d6cf601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.754467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18ca1d-2282-4f9a-86e0-bd979d6cf601 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.754763 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18ca1d-2282-4f9a-86e0-bd979d6cf601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.755650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18ca1d-2282-4f9a-86e0-bd979d6cf601 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.756659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18ca1d-2282-4f9a-86e0-bd979d6cf601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:31.759431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18ca1d-2282-4f9a-86e0-bd979d6cf601 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:31.788520 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1043/2098] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:31 2022] POST /identity/v3/users => generated 294 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:31.793129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18ca1d-2282-4f9a-86e0-bd979d6cf601 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.795239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9394667740f44bcab24ee484b195fe96'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.803645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18ca1d-2282-4f9a-86e0-bd979d6cf601 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.809012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.809749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.810127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.810513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.811241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:31.811564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9394667740f44bcab24ee484b195fe96'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.812278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9394667740f44bcab24ee484b195fe96'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.813155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:31.819955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9394667740f44bcab24ee484b195fe96'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.820613 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9394667740f44bcab24ee484b195fe96'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:31.827695 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1044/2099] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:05:31.828909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.830901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:31.834404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1056/2100] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:31 2022] DELETE /identity/v3/users/9394667740f44bcab24ee484b195fe96 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:31.845355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50272d4c-1b73-4e9f-8163-f6445c862f5b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.919397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011811-acf9-4e2c-8889-161ad31fdf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.920207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011811-acf9-4e2c-8889-161ad31fdf29 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.920637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011811-acf9-4e2c-8889-161ad31fdf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.921443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011811-acf9-4e2c-8889-161ad31fdf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:31.922866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4011811-acf9-4e2c-8889-161ad31fdf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:31.924947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4011811-acf9-4e2c-8889-161ad31fdf29 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:31.937782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1045/2101] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:31.941331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:31.956715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8e423-ec4e-4366-bde3-e1b5b3c0186b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:31.995320 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:31.998255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:31.998900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:31.998900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] PATH_INFO: `/v3/projects/7c9d75f508754afa9dd1f854b7aa7a77/users/b6381bf9bdc44cdbb5ab0a3d346a8b4a/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.022109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9d75f508754afa9dd1f854b7aa7a77, user_id=b6381bf9bdc44cdbb5ab0a3d346a8b4a, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.025736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.042806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1057/2102] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:31 2022] PUT /identity/v3/projects/7c9d75f508754afa9dd1f854b7aa7a77/users/b6381bf9bdc44cdbb5ab0a3d346a8b4a/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:32.053078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fabecf-a690-4755-bf4b-cfcf28bbe765 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.053503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fabecf-a690-4755-bf4b-cfcf28bbe765 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.053984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fabecf-a690-4755-bf4b-cfcf28bbe765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.102473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a2fabecf-a690-4755-bf4b-cfcf28bbe765 None None] MFA Rules not processed for user `b6381bf9bdc44cdbb5ab0a3d346a8b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:32.107868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.110006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:32.111023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a2fabecf-a690-4755-bf4b-cfcf28bbe765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:32.199213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:32.215496 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1046/2103] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:32.219941 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fabecf-a690-4755-bf4b-cfcf28bbe765 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.227716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111458-6ecc-43f9-aae2-6d775b49ee8d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.231583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fabecf-a690-4755-bf4b-cfcf28bbe765 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.232573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.233182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.233460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.233758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] PATH_INFO: `/v3/projects/9247e549c63f4a42be20f5a7aeda0594` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.235140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9247e549c63f4a42be20f5a7aeda0594)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.237080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.237626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.237843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.238193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.238648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.239283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.241931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.280549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1047/2104] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:32 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:05:32.281638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.284097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:32.293880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9247e549c63f4a42be20f5a7aeda0594', 'request_id': 'req-ce243633-b8e5-496a-910c-83bc91842b5c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:32.299594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9247e549c63f4a42be20f5a7aeda0594', 'request_id': 'req-ce243633-b8e5-496a-910c-83bc91842b5c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:32.301162 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:32.311815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9247e549c63f4a42be20f5a7aeda0594', 'request_id': 'req-ce243633-b8e5-496a-910c-83bc91842b5c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:32.327153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] The token cache is being invalidate because project 9247e549c63f4a42be20f5a7aeda0594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:32.327755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:32.328344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:32.330078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1058/2105] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:32 2022] DELETE /identity/v3/projects/9247e549c63f4a42be20f5a7aeda0594 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:32.333422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.333422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:32.366505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9971d6e-640b-4d3f-bddf-a27c47d54105 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.404694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243633-b8e5-496a-910c-83bc91842b5c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.410813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0bceb-46c9-4e4d-a755-cde4cc346a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.411504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0bceb-46c9-4e4d-a755-cde4cc346a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.411784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0bceb-46c9-4e4d-a755-cde4cc346a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.412058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0bceb-46c9-4e4d-a755-cde4cc346a2a admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.412691 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0bceb-46c9-4e4d-a755-cde4cc346a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.414879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0bceb-46c9-4e4d-a755-cde4cc346a2a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.435653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.436422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.436769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.437101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.438916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1059/2106] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:32 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:32.440286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34fe06-6c23-4d0a-b3ee-649804596219 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.440479 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34fe06-6c23-4d0a-b3ee-649804596219 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.440760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34fe06-6c23-4d0a-b3ee-649804596219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.441921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:32.462293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ee34fe06-6c23-4d0a-b3ee-649804596219 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:32.463575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ee34fe06-6c23-4d0a-b3ee-649804596219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:32.471879 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1060/2107] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:32.472695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34fe06-6c23-4d0a-b3ee-649804596219 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.483770 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34fe06-6c23-4d0a-b3ee-649804596219 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.488766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21632d-05fb-40ba-9721-759bd36ef2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.489364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21632d-05fb-40ba-9721-759bd36ef2ed admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.489677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21632d-05fb-40ba-9721-759bd36ef2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.489940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21632d-05fb-40ba-9721-759bd36ef2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.490575 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21632d-05fb-40ba-9721-759bd36ef2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.492744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21632d-05fb-40ba-9721-759bd36ef2ed admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.504578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1061/2108] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:32.506878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4df93-36c6-4c28-82e7-78c886fbd1b9 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.507161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4df93-36c6-4c28-82e7-78c886fbd1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.507505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4df93-36c6-4c28-82e7-78c886fbd1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.519356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.520978 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.530852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1048/2109] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:32.530956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5fe4df93-36c6-4c28-82e7-78c886fbd1b9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:32.531467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.531990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5fe4df93-36c6-4c28-82e7-78c886fbd1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:32.540472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1062/2110] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:32.543817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618f535-612c-476c-994e-cbc38c6643e6 service nova] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.545016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4df93-36c6-4c28-82e7-78c886fbd1b9 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.550297 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76381136-231e-476d-9bee-0ff7e275bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.551217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381136-231e-476d-9bee-0ff7e275bb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.551717 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381136-231e-476d-9bee-0ff7e275bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.552067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381136-231e-476d-9bee-0ff7e275bb6b admin admin] PATH_INFO: `/v3/projects/18f52d5db69c4273836c5dcee8b16230/users/84c2be5076404eb386f679e2ae86c1e7/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.556478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:32.557311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4df93-36c6-4c28-82e7-78c886fbd1b9 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.564995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.565644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.566085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.566366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.567024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:05:32.567331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.568932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.573787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76381136-231e-476d-9bee-0ff7e275bb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f52d5db69c4273836c5dcee8b16230, user_id=84c2be5076404eb386f679e2ae86c1e7, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.577209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76381136-231e-476d-9bee-0ff7e275bb6b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.585639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1063/2111] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:05:32.595010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.606677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1049/2112] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:32 2022] PUT /identity/v3/projects/18f52d5db69c4273836c5dcee8b16230/users/84c2be5076404eb386f679e2ae86c1e7/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:32.607632 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76381136-231e-476d-9bee-0ff7e275bb6b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.609011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8fb5-2497-48dc-9cbf-5cbe1ea1067d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.699090 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76381136-231e-476d-9bee-0ff7e275bb6b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.699663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c250c-4703-4027-a577-b3400dbf846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.700473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c250c-4703-4027-a577-b3400dbf846a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.700996 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c250c-4703-4027-a577-b3400dbf846a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.701433 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c250c-4703-4027-a577-b3400dbf846a admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.702460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c250c-4703-4027-a577-b3400dbf846a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.704104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a254e5-5bda-492e-b7a8-f605c12aeedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.704718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a254e5-5bda-492e-b7a8-f605c12aeedf admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.704990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a254e5-5bda-492e-b7a8-f605c12aeedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.705255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a254e5-5bda-492e-b7a8-f605c12aeedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.705601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c250c-4703-4027-a577-b3400dbf846a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.706023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a254e5-5bda-492e-b7a8-f605c12aeedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.707631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a254e5-5bda-492e-b7a8-f605c12aeedf admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.722122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1050/2113] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:32.723352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a254e5-5bda-492e-b7a8-f605c12aeedf admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.735663 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a254e5-5bda-492e-b7a8-f605c12aeedf admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.741265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32790a76-5894-4d58-9394-cdb78dd966c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.742142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790a76-5894-4d58-9394-cdb78dd966c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.742949 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790a76-5894-4d58-9394-cdb78dd966c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.743214 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32790a76-5894-4d58-9394-cdb78dd966c2 admin admin] PATH_INFO: `/v3/projects/18f52d5db69c4273836c5dcee8b16230/users/84c2be5076404eb386f679e2ae86c1e7/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.745799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32790a76-5894-4d58-9394-cdb78dd966c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f52d5db69c4273836c5dcee8b16230, user_id=84c2be5076404eb386f679e2ae86c1e7, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.749851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32790a76-5894-4d58-9394-cdb78dd966c2 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.750940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1064/2114] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:32 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:32.754786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c250c-4703-4027-a577-b3400dbf846a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:32.771004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1051/2115] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:32 2022] PUT /identity/v3/projects/18f52d5db69c4273836c5dcee8b16230/users/84c2be5076404eb386f679e2ae86c1e7/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:32.783531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed8cc-56b2-442f-bd46-50e56ea2de43 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.783531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed8cc-56b2-442f-bd46-50e56ea2de43 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.783531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed8cc-56b2-442f-bd46-50e56ea2de43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.787152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:32.835443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-109ed8cc-56b2-442f-bd46-50e56ea2de43 None None] MFA Rules not processed for user `84c2be5076404eb386f679e2ae86c1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:32.836753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-109ed8cc-56b2-442f-bd46-50e56ea2de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:32.856860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c250c-4703-4027-a577-b3400dbf846a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:32.947878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:32.949233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:32.949608 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:32.949947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:32.950791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:32.953091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:32.988228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1052/2116] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:32.995258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1065/2117] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:32 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:05:33.005659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ed8cc-56b2-442f-bd46-50e56ea2de43 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:33.009665 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:33.011833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:33.017646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ed8cc-56b2-442f-bd46-50e56ea2de43 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:33.023869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defde44-a318-4caa-a622-52befdc102df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:33.024688 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defde44-a318-4caa-a622-52befdc102df admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.024970 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defde44-a318-4caa-a622-52befdc102df admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.025245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defde44-a318-4caa-a622-52befdc102df admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.025947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defde44-a318-4caa-a622-52befdc102df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:33.028446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defde44-a318-4caa-a622-52befdc102df admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:33.054130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1053/2118] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:33.055666 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defde44-a318-4caa-a622-52befdc102df admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:33.066259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defde44-a318-4caa-a622-52befdc102df admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:33.085167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc26c-b757-4f33-ae83-d0c19f47517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:33.087338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc26c-b757-4f33-ae83-d0c19f47517c admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.087615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc26c-b757-4f33-ae83-d0c19f47517c admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.087883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc26c-b757-4f33-ae83-d0c19f47517c admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.088535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc26c-b757-4f33-ae83-d0c19f47517c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:33.090246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc26c-b757-4f33-ae83-d0c19f47517c admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:33.095214 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9525d-3dbd-4e6f-89a3-377559926fff admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:33.105174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1054/2119] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:05:33.106160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e550d-1c63-4cf4-aa72-68536ba28e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:33.106391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc26c-b757-4f33-ae83-d0c19f47517c admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:33.106916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e550d-1c63-4cf4-aa72-68536ba28e22 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.107340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e550d-1c63-4cf4-aa72-68536ba28e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.107619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e550d-1c63-4cf4-aa72-68536ba28e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.117308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc26c-b757-4f33-ae83-d0c19f47517c admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:33.122034 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a116c9-6d8a-4e0b-8659-82fab9b3abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:33.122690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a116c9-6d8a-4e0b-8659-82fab9b3abb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.122971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a116c9-6d8a-4e0b-8659-82fab9b3abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.123402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a116c9-6d8a-4e0b-8659-82fab9b3abb5 admin admin] PATH_INFO: `/v3/projects/5044e322520f485d942885c4ce6554b2/users/5ceb0f3e22b246d8a3f5ced16295fa80/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.124750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e550d-1c63-4cf4-aa72-68536ba28e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:33.126684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e550d-1c63-4cf4-aa72-68536ba28e22 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:33.138451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1066/2120] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:05:33.141788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a116c9-6d8a-4e0b-8659-82fab9b3abb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5044e322520f485d942885c4ce6554b2, user_id=5ceb0f3e22b246d8a3f5ced16295fa80, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:33.144569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a116c9-6d8a-4e0b-8659-82fab9b3abb5 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:33.160311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1055/2121] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:33 2022] PUT /identity/v3/projects/5044e322520f485d942885c4ce6554b2/users/5ceb0f3e22b246d8a3f5ced16295fa80/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:33.174569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a116c9-6d8a-4e0b-8659-82fab9b3abb5 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:33.176553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51c96-c43a-45f4-baa1-cffee06a1ef2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.176839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51c96-c43a-45f4-baa1-cffee06a1ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.177109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51c96-c43a-45f4-baa1-cffee06a1ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.181393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:33.207828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-88e51c96-c43a-45f4-baa1-cffee06a1ef2 None None] MFA Rules not processed for user `5ceb0f3e22b246d8a3f5ced16295fa80`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:33.209590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-88e51c96-c43a-45f4-baa1-cffee06a1ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:33.248673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a116c9-6d8a-4e0b-8659-82fab9b3abb5 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:33.254217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:33.254954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.255406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.257418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] PATH_INFO: `/v3/users/b6381bf9bdc44cdbb5ab0a3d346a8b4a` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.257418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6381bf9bdc44cdbb5ab0a3d346a8b4a)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:33.259413 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:33.283125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:33.300605 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1067/2122] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:33.312280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51c96-c43a-45f4-baa1-cffee06a1ef2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:33.313805 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-88e51c96-c43a-45f4-baa1-cffee06a1ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:33.320343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6381bf9bdc44cdbb5ab0a3d346a8b4a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:33.334108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6381bf9bdc44cdbb5ab0a3d346a8b4a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:33.334879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6381bf9bdc44cdbb5ab0a3d346a8b4a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:33.343536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6381bf9bdc44cdbb5ab0a3d346a8b4a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:33.344476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-0086a772-7c70-4f3a-9259-fa801dd5c41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6381bf9bdc44cdbb5ab0a3d346a8b4a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:33.357646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1056/2123] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:33 2022] DELETE /identity/v3/users/b6381bf9bdc44cdbb5ab0a3d346a8b4a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:33.362474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238f3f8-ffa8-48a4-ba86-f875af3771c6 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.362732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238f3f8-ffa8-48a4-ba86-f875af3771c6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.363001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238f3f8-ffa8-48a4-ba86-f875af3771c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.388754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d238f3f8-ffa8-48a4-ba86-f875af3771c6 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:33.390025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d238f3f8-ffa8-48a4-ba86-f875af3771c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:33.407843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51c96-c43a-45f4-baa1-cffee06a1ef2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:33.467220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1057/2124] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:33.477685 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238f3f8-ffa8-48a4-ba86-f875af3771c6 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:33.479083 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d238f3f8-ffa8-48a4-ba86-f875af3771c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:33.494509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:33.495428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.495716 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.495970 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.497785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:33.510982 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:33.554463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238f3f8-ffa8-48a4-ba86-f875af3771c6 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:33.558374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:33.558984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.559259 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.559530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.569466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:33.571478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:33.575674 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:33.577282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:33.584278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1058/2125] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:33.587404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1068/2126] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:33.890834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:33.892250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:33.918435 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421007f2-227f-49b9-97e0-ce68c771bebc service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:33.923562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:33.935461 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:33.936892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:33.937241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] PATH_INFO: `/v3/projects/7c9d75f508754afa9dd1f854b7aa7a77` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:33.940264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9d75f508754afa9dd1f854b7aa7a77)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:33.944901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:34.048350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9d75f508754afa9dd1f854b7aa7a77', 'request_id': 'req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.056715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9d75f508754afa9dd1f854b7aa7a77', 'request_id': 'req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.063790 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9d75f508754afa9dd1f854b7aa7a77', 'request_id': 'req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.089935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] The token cache is being invalidate because project 7c9d75f508754afa9dd1f854b7aa7a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:34.090318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.090863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.092562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1059/2127] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:33 2022] DELETE /identity/v3/projects/7c9d75f508754afa9dd1f854b7aa7a77 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:34.097289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:34.112075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f2c8-0e48-4832-8d69-acc011d47ee2 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:34.146623 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:34.186397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:34.187047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:34.187328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:34.187601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] PATH_INFO: `/v3/users/84c2be5076404eb386f679e2ae86c1e7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:34.188758 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c2be5076404eb386f679e2ae86c1e7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:34.190722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:34.249335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c2be5076404eb386f679e2ae86c1e7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.266577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c2be5076404eb386f679e2ae86c1e7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.267372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c2be5076404eb386f679e2ae86c1e7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.277664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c2be5076404eb386f679e2ae86c1e7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.278507 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b9b28377-b460-4000-9b0c-91f08045d94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c2be5076404eb386f679e2ae86c1e7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.293959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1069/2128] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:34 2022] DELETE /identity/v3/users/84c2be5076404eb386f679e2ae86c1e7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:34.630535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:34.632170 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:34.645711 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768c7c2-e1a1-48ed-8bc0-c7c2cf5eef62 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:34.706227 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:34.706884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:34.707167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:34.707436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] PATH_INFO: `/v3/projects/18f52d5db69c4273836c5dcee8b16230` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:34.708562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f52d5db69c4273836c5dcee8b16230)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:34.710532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:34.763347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f52d5db69c4273836c5dcee8b16230', 'request_id': 'req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.765420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:34.770596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f52d5db69c4273836c5dcee8b16230', 'request_id': 'req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.778878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f52d5db69c4273836c5dcee8b16230', 'request_id': 'req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.794598 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] The token cache is being invalidate because project 18f52d5db69c4273836c5dcee8b16230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:34.795022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.795665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ebc619c3-4303-40c7-bcc0-7ad937fe5e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:34.797503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1060/2129] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:34 2022] DELETE /identity/v3/projects/18f52d5db69c4273836c5dcee8b16230 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:34.802687 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae16a2c-7e4e-42d1-a4ab-d3c3f6083e66 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:34.803307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae16a2c-7e4e-42d1-a4ab-d3c3f6083e66 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:34.803592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae16a2c-7e4e-42d1-a4ab-d3c3f6083e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:34.828097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-dae16a2c-7e4e-42d1-a4ab-d3c3f6083e66 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:34.829293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-dae16a2c-7e4e-42d1-a4ab-d3c3f6083e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:34.891881 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1070/2130] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:05:34.900407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db2ac-b33d-4ea9-8335-505af9ae994d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:34.900693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db2ac-b33d-4ea9-8335-505af9ae994d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:34.900996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db2ac-b33d-4ea9-8335-505af9ae994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:34.921072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-be8db2ac-b33d-4ea9-8335-505af9ae994d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:34.922333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-be8db2ac-b33d-4ea9-8335-505af9ae994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:34.931574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1061/2131] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:34.935782 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae16a2c-7e4e-42d1-a4ab-d3c3f6083e66 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:34.945609 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae16a2c-7e4e-42d1-a4ab-d3c3f6083e66 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:34.950405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac721e-d51b-4bcd-9de4-56bbadd29c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:34.951015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac721e-d51b-4bcd-9de4-56bbadd29c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:34.951788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac721e-d51b-4bcd-9de4-56bbadd29c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:34.952072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac721e-d51b-4bcd-9de4-56bbadd29c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:34.952730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac721e-d51b-4bcd-9de4-56bbadd29c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:05:34.953037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac721e-d51b-4bcd-9de4-56bbadd29c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:34.954793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac721e-d51b-4bcd-9de4-56bbadd29c89 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:34.970243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1071/2132] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:05:34.971165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8db2ac-b33d-4ea9-8335-505af9ae994d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:34.988030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8db2ac-b33d-4ea9-8335-505af9ae994d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:34.993318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c4bb-4c36-45f5-9a4f-0e8f26482cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:34.993972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c4bb-4c36-45f5-9a4f-0e8f26482cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:34.994250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c4bb-4c36-45f5-9a4f-0e8f26482cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:34.994528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c4bb-4c36-45f5-9a4f-0e8f26482cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:34.995184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c4bb-4c36-45f5-9a4f-0e8f26482cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:34.997075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c4bb-4c36-45f5-9a4f-0e8f26482cb1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.001202 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4970-9dd4-4756-84c4-ee90b21bad27 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.001591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4970-9dd4-4756-84c4-ee90b21bad27 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.001932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d4970-9dd4-4756-84c4-ee90b21bad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.022376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-be5d4970-9dd4-4756-84c4-ee90b21bad27 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:35.023667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-be5d4970-9dd4-4756-84c4-ee90b21bad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:35.025456 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1062/2133] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:34 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:35.030031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c4bb-4c36-45f5-9a4f-0e8f26482cb1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:35.056050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:35.083979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1072/2134] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:05:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:05:35.097151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4970-9dd4-4756-84c4-ee90b21bad27 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:35.097920 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c4bb-4c36-45f5-9a4f-0e8f26482cb1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:35.098683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-be5d4970-9dd4-4756-84c4-ee90b21bad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:35.104155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d294-3f61-450b-b0ed-f7317db3a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:35.104546 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d294-3f61-450b-b0ed-f7317db3a155 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.104983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d294-3f61-450b-b0ed-f7317db3a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.105261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d294-3f61-450b-b0ed-f7317db3a155 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.105933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79d294-3f61-450b-b0ed-f7317db3a155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:35.107843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79d294-3f61-450b-b0ed-f7317db3a155 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.137374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1063/2135] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:35 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:05:35.141672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d294-3f61-450b-b0ed-f7317db3a155 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:35.153681 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d294-3f61-450b-b0ed-f7317db3a155 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:35.158646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9a59-3d72-476e-a4b8-6c6edc20ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:35.159346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9a59-3d72-476e-a4b8-6c6edc20ab2b admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.159740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9a59-3d72-476e-a4b8-6c6edc20ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.160204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9a59-3d72-476e-a4b8-6c6edc20ab2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.160778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da9a59-3d72-476e-a4b8-6c6edc20ab2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:35.162569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da9a59-3d72-476e-a4b8-6c6edc20ab2b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.176350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1064/2136] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:35.177448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9a59-3d72-476e-a4b8-6c6edc20ab2b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:35.188704 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9a59-3d72-476e-a4b8-6c6edc20ab2b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:35.193675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e017-2898-417c-bb1e-450e92b51be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:35.194349 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e017-2898-417c-bb1e-450e92b51be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.194630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e017-2898-417c-bb1e-450e92b51be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.194952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379e017-2898-417c-bb1e-450e92b51be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.196116 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e017-2898-417c-bb1e-450e92b51be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:35.197827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379e017-2898-417c-bb1e-450e92b51be8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.199087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d4970-9dd4-4756-84c4-ee90b21bad27 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:35.207234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d08e7-45ad-4b35-b8cc-213e87d31e03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:35.208364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d08e7-45ad-4b35-b8cc-213e87d31e03 service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.208726 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d08e7-45ad-4b35-b8cc-213e87d31e03 service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.209102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d08e7-45ad-4b35-b8cc-213e87d31e03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.212709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1065/2137] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:05:35.214135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e017-2898-417c-bb1e-450e92b51be8 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:35.219020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d08e7-45ad-4b35-b8cc-213e87d31e03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:35.220739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d08e7-45ad-4b35-b8cc-213e87d31e03 service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.225581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379e017-2898-417c-bb1e-450e92b51be8 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:35.231486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc388b-c3ad-4817-ae1c-cef5dbc0d2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:35.231943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1073/2138] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 13:05:35.232289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc388b-c3ad-4817-ae1c-cef5dbc0d2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.232574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc388b-c3ad-4817-ae1c-cef5dbc0d2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.232851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc388b-c3ad-4817-ae1c-cef5dbc0d2b8 admin admin] PATH_INFO: `/v3/projects/a478db8c58884bde9948eab0e282ea65/users/2063fd922bfc4b998e885110df0a4849/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.250197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc388b-c3ad-4817-ae1c-cef5dbc0d2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a478db8c58884bde9948eab0e282ea65, user_id=2063fd922bfc4b998e885110df0a4849, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:35.252936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc388b-c3ad-4817-ae1c-cef5dbc0d2b8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.269881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1066/2139] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:35 2022] PUT /identity/v3/projects/a478db8c58884bde9948eab0e282ea65/users/2063fd922bfc4b998e885110df0a4849/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:35.281055 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359aa07-6f5d-4638-8323-4f884375d2f4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.281469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359aa07-6f5d-4638-8323-4f884375d2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.281854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359aa07-6f5d-4638-8323-4f884375d2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.314421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6359aa07-6f5d-4638-8323-4f884375d2f4 None None] MFA Rules not processed for user `2063fd922bfc4b998e885110df0a4849`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:35.315898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6359aa07-6f5d-4638-8323-4f884375d2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:35.473946 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1074/2140] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:35.475129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc388b-c3ad-4817-ae1c-cef5dbc0d2b8 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:35.602554 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:35.625683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc388b-c3ad-4817-ae1c-cef5dbc0d2b8 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:35.634498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a72a7-0e1e-4784-a016-bad5a8981c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:35.635798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a72a7-0e1e-4784-a016-bad5a8981c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.636288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a72a7-0e1e-4784-a016-bad5a8981c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.636779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a72a7-0e1e-4784-a016-bad5a8981c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.637686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a72a7-0e1e-4784-a016-bad5a8981c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:35.641067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a72a7-0e1e-4784-a016-bad5a8981c06 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.702637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1067/2141] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:35 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:35.706798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359aa07-6f5d-4638-8323-4f884375d2f4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:35.728414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359aa07-6f5d-4638-8323-4f884375d2f4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:35.878386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1cd98-0625-4f1a-979a-280392ec8c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:35.879628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1cd98-0625-4f1a-979a-280392ec8c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.880269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1cd98-0625-4f1a-979a-280392ec8c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.880754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1cd98-0625-4f1a-979a-280392ec8c61 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.882334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1cd98-0625-4f1a-979a-280392ec8c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:35.886438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1cd98-0625-4f1a-979a-280392ec8c61 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.900394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:35.939922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1075/2142] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:35 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:35.941295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a72a7-0e1e-4784-a016-bad5a8981c06 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:35.953449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a72a7-0e1e-4784-a016-bad5a8981c06 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:35.958657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d1247-53f6-4e66-b6b0-087677506b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:35.959371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d1247-53f6-4e66-b6b0-087677506b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:35.959859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d1247-53f6-4e66-b6b0-087677506b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:35.960203 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d1247-53f6-4e66-b6b0-087677506b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:35.962610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d1247-53f6-4e66-b6b0-087677506b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:35.964351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d1247-53f6-4e66-b6b0-087677506b7f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:35.978657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1068/2143] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:35.983785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1cd98-0625-4f1a-979a-280392ec8c61 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:36.001087 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1cd98-0625-4f1a-979a-280392ec8c61 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:36.009123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bde719-ac19-4931-8f38-f6b0e2247c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:36.010126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bde719-ac19-4931-8f38-f6b0e2247c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:36.010544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bde719-ac19-4931-8f38-f6b0e2247c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:36.010889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bde719-ac19-4931-8f38-f6b0e2247c96 admin admin] PATH_INFO: `/v3/projects/dddfaa9dc8fe4e548bf29ca82b7da829/users/2ac55406886b4df3a4ac2c89c3c4e138/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:36.030545 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bde719-ac19-4931-8f38-f6b0e2247c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dddfaa9dc8fe4e548bf29ca82b7da829, user_id=2ac55406886b4df3a4ac2c89c3c4e138, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:36.033666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bde719-ac19-4931-8f38-f6b0e2247c96 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:36.057426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1076/2144] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:35 2022] PUT /identity/v3/projects/dddfaa9dc8fe4e548bf29ca82b7da829/users/2ac55406886b4df3a4ac2c89c3c4e138/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:36.061175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d1247-53f6-4e66-b6b0-087677506b7f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:36.072636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d1247-53f6-4e66-b6b0-087677506b7f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:36.196796 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a239f97-fa4c-4424-8448-4631650bf939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:36.197610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a239f97-fa4c-4424-8448-4631650bf939 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:36.197892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a239f97-fa4c-4424-8448-4631650bf939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:36.198171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a239f97-fa4c-4424-8448-4631650bf939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:36.198969 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a239f97-fa4c-4424-8448-4631650bf939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:36.200584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a239f97-fa4c-4424-8448-4631650bf939 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:36.214862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1069/2145] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:05:36.219059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bde719-ac19-4931-8f38-f6b0e2247c96 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:36.230998 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bde719-ac19-4931-8f38-f6b0e2247c96 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:36.236140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:36.236928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:36.237342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:36.237679 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] PATH_INFO: `/v3/projects/dddfaa9dc8fe4e548bf29ca82b7da829/users/2ac55406886b4df3a4ac2c89c3c4e138/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:36.239842 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dddfaa9dc8fe4e548bf29ca82b7da829, user_id=2ac55406886b4df3a4ac2c89c3c4e138, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:36.242596 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:36.254093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1077/2146] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:36 2022] PUT /identity/v3/projects/dddfaa9dc8fe4e548bf29ca82b7da829/users/2ac55406886b4df3a4ac2c89c3c4e138/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:36.265511 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14914a-031f-4eef-9eb0-711046e99ea0 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:36.265814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14914a-031f-4eef-9eb0-711046e99ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:36.266091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14914a-031f-4eef-9eb0-711046e99ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:36.297718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ff14914a-031f-4eef-9eb0-711046e99ea0 None None] MFA Rules not processed for user `2ac55406886b4df3a4ac2c89c3c4e138`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:36.299118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ff14914a-031f-4eef-9eb0-711046e99ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:36.365559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1070/2147] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:36.377083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:36.378989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:36.441908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f65f3-280d-40af-a2e0-8832cd16b126 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:36.446559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314f3d-f0d6-4328-80ea-1fb4dbdd69c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:36.447515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314f3d-f0d6-4328-80ea-1fb4dbdd69c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:36.447826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314f3d-f0d6-4328-80ea-1fb4dbdd69c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:36.448099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314f3d-f0d6-4328-80ea-1fb4dbdd69c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:36.458215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02314f3d-f0d6-4328-80ea-1fb4dbdd69c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:36.459648 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02314f3d-f0d6-4328-80ea-1fb4dbdd69c2 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:36.470701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1078/2148] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:36.552911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14914a-031f-4eef-9eb0-711046e99ea0 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:36.610954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:36.623567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14914a-031f-4eef-9eb0-711046e99ea0 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:36.628240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:36.628867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:36.629147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:36.629418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] PATH_INFO: `/v3/users/2063fd922bfc4b998e885110df0a4849` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:36.630593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2063fd922bfc4b998e885110df0a4849)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:36.633043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:36.715806 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2063fd922bfc4b998e885110df0a4849'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:36.731660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2063fd922bfc4b998e885110df0a4849'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:36.732473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2063fd922bfc4b998e885110df0a4849'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:36.742355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2063fd922bfc4b998e885110df0a4849'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:36.743076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2063fd922bfc4b998e885110df0a4849'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:36.758617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1071/2149] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:36 2022] DELETE /identity/v3/users/2063fd922bfc4b998e885110df0a4849 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:36.762763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad92e-81f2-4698-a442-807bcf78579d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:36.763051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad92e-81f2-4698-a442-807bcf78579d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:36.763326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaad92e-81f2-4698-a442-807bcf78579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:36.788200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bbaad92e-81f2-4698-a442-807bcf78579d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:36.801523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bbaad92e-81f2-4698-a442-807bcf78579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:36.883755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1079/2150] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:36.893513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:36.894915 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:36.971120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a61cb-c69c-4066-9260-d2697f51a2c9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:36.979185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329622b-2a62-4ea5-932b-32e5dc0221fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:36.979185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329622b-2a62-4ea5-932b-32e5dc0221fc service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:36.979185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329622b-2a62-4ea5-932b-32e5dc0221fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:36.979185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329622b-2a62-4ea5-932b-32e5dc0221fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:36.992690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329622b-2a62-4ea5-932b-32e5dc0221fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:36.993729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329622b-2a62-4ea5-932b-32e5dc0221fc service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:37.009076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1072/2151] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:37.320278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaad92e-81f2-4698-a442-807bcf78579d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:37.322656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bbaad92e-81f2-4698-a442-807bcf78579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:37.357067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaad92e-81f2-4698-a442-807bcf78579d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:37.362798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:37.363517 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:37.363870 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:37.364273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] PATH_INFO: `/v3/projects/a478db8c58884bde9948eab0e282ea65` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:37.366228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a478db8c58884bde9948eab0e282ea65)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:37.368857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:37.416722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a478db8c58884bde9948eab0e282ea65', 'request_id': 'req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.417914 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:37.423466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a478db8c58884bde9948eab0e282ea65', 'request_id': 'req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.431438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a478db8c58884bde9948eab0e282ea65', 'request_id': 'req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.443307 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] The token cache is being invalidate because project a478db8c58884bde9948eab0e282ea65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:37.443597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.444210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.445841 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1080/2152] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:37 2022] DELETE /identity/v3/projects/a478db8c58884bde9948eab0e282ea65 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:37.449826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329622b-2a62-4ea5-932b-32e5dc0221fc service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:37.459550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329622b-2a62-4ea5-932b-32e5dc0221fc service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:37.518998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:37.519993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:37.520266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:37.520536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] PATH_INFO: `/v3/users/2ac55406886b4df3a4ac2c89c3c4e138` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:37.521826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac55406886b4df3a4ac2c89c3c4e138)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:37.524512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:37.540035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:37.594394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac55406886b4df3a4ac2c89c3c4e138'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.608932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac55406886b4df3a4ac2c89c3c4e138'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.609669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac55406886b4df3a4ac2c89c3c4e138'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.617316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac55406886b4df3a4ac2c89c3c4e138'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.617958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-8dc6aabe-76e7-4e4b-b3be-320c50776036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac55406886b4df3a4ac2c89c3c4e138'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:37.629812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1073/2153] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:37 2022] DELETE /identity/v3/users/2ac55406886b4df3a4ac2c89c3c4e138 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:38.002012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:38.003515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:38.021100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3ac5c-06d8-4f00-b787-c7f993cd7f0f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:38.090767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:38.091407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.091678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.091947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] PATH_INFO: `/v3/projects/dddfaa9dc8fe4e548bf29ca82b7da829` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.093738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] RBAC: Authorizing `identity:delete_project(project_id=dddfaa9dc8fe4e548bf29ca82b7da829)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:38.095794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:38.178276 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dddfaa9dc8fe4e548bf29ca82b7da829', 'request_id': 'req-7ba3a98f-037e-4016-8c8e-e06a14936def'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:38.192535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dddfaa9dc8fe4e548bf29ca82b7da829', 'request_id': 'req-7ba3a98f-037e-4016-8c8e-e06a14936def'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:38.205727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dddfaa9dc8fe4e548bf29ca82b7da829', 'request_id': 'req-7ba3a98f-037e-4016-8c8e-e06a14936def'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:38.227708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] The token cache is being invalidate because project dddfaa9dc8fe4e548bf29ca82b7da829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:38.228000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:38.228685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7ba3a98f-037e-4016-8c8e-e06a14936def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:38.230233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1081/2154] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:38 2022] DELETE /identity/v3/projects/dddfaa9dc8fe4e548bf29ca82b7da829 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:38.235371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659bad-85bb-4ee3-948d-31f9b47d6493 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.235857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659bad-85bb-4ee3-948d-31f9b47d6493 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.236045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0659bad-85bb-4ee3-948d-31f9b47d6493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.256958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f0659bad-85bb-4ee3-948d-31f9b47d6493 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:38.259140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f0659bad-85bb-4ee3-948d-31f9b47d6493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:38.323981 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1074/2155] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:05:38.388855 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6175c8-b4ba-4473-8d52-45e0d9e1a100 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.389133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6175c8-b4ba-4473-8d52-45e0d9e1a100 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.389396 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6175c8-b4ba-4473-8d52-45e0d9e1a100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.414756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fe6175c8-b4ba-4473-8d52-45e0d9e1a100 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:38.416651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fe6175c8-b4ba-4473-8d52-45e0d9e1a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:38.425427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1082/2156] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:38.430017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0659bad-85bb-4ee3-948d-31f9b47d6493 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:38.439629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0659bad-85bb-4ee3-948d-31f9b47d6493 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:38.444150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:38.444736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.445605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.445888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.446528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:05:38.446825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:38.448398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:38.459535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1075/2157] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:05:38.464018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6175c8-b4ba-4473-8d52-45e0d9e1a100 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:38.473043 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6175c8-b4ba-4473-8d52-45e0d9e1a100 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:38.477762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231b06f-c91f-469c-b1ec-b18929b1ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:38.478357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b06f-c91f-469c-b1ec-b18929b1ab9a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.478632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b06f-c91f-469c-b1ec-b18929b1ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.478900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b06f-c91f-469c-b1ec-b18929b1ab9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.479530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231b06f-c91f-469c-b1ec-b18929b1ab9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:38.481414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231b06f-c91f-469c-b1ec-b18929b1ab9a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:38.510064 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1083/2158] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:38 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:38.514173 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:38.524255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cff46-b3c4-4fea-96a8-c8920187429a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:38.584913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228f795-43da-48d1-9470-95695bf53e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:38.585445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f795-43da-48d1-9470-95695bf53e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.585889 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f795-43da-48d1-9470-95695bf53e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.586164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f795-43da-48d1-9470-95695bf53e1e admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.586806 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f795-43da-48d1-9470-95695bf53e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:38.588729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f795-43da-48d1-9470-95695bf53e1e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:38.620078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1076/2159] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:38 2022] POST /identity/v3/users => generated 304 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:38.624247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231b06f-c91f-469c-b1ec-b18929b1ab9a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:38.635411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231b06f-c91f-469c-b1ec-b18929b1ab9a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:38.641904 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0afcc0-59e8-47e0-818c-9e981fb9c522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:38.642781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afcc0-59e8-47e0-818c-9e981fb9c522 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.643050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afcc0-59e8-47e0-818c-9e981fb9c522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.643513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afcc0-59e8-47e0-818c-9e981fb9c522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.644193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0afcc0-59e8-47e0-818c-9e981fb9c522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:38.645825 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0afcc0-59e8-47e0-818c-9e981fb9c522 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:38.657153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1084/2160] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:38.661375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228f795-43da-48d1-9470-95695bf53e1e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:38.672058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228f795-43da-48d1-9470-95695bf53e1e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:38.676854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f02c5-4432-4b00-ac87-7c93fa6980d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:38.677661 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f02c5-4432-4b00-ac87-7c93fa6980d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.677998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f02c5-4432-4b00-ac87-7c93fa6980d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.678217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f02c5-4432-4b00-ac87-7c93fa6980d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.678934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f02c5-4432-4b00-ac87-7c93fa6980d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:38.681249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f02c5-4432-4b00-ac87-7c93fa6980d3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:38.683409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:38.693213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1077/2161] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:38.697419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0afcc0-59e8-47e0-818c-9e981fb9c522 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:38.708377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0afcc0-59e8-47e0-818c-9e981fb9c522 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:38.713792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bbdef-53ec-449f-88b9-f909b1bc2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:38.714614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbdef-53ec-449f-88b9-f909b1bc2a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.714899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbdef-53ec-449f-88b9-f909b1bc2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.715172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbdef-53ec-449f-88b9-f909b1bc2a1d admin admin] PATH_INFO: `/v3/projects/c8de45680f964779981727737f86b422/users/25f43321bcd64cf79795e4168f5f04c0/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.734546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bbdef-53ec-449f-88b9-f909b1bc2a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8de45680f964779981727737f86b422, user_id=25f43321bcd64cf79795e4168f5f04c0, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:38.737658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bbdef-53ec-449f-88b9-f909b1bc2a1d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:38.752569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1085/2162] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:38 2022] PUT /identity/v3/projects/c8de45680f964779981727737f86b422/users/25f43321bcd64cf79795e4168f5f04c0/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:38.769183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be8d2-dfc5-4239-aaee-b5ffe07e5e01 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.769463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be8d2-dfc5-4239-aaee-b5ffe07e5e01 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.769765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be8d2-dfc5-4239-aaee-b5ffe07e5e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.803079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-560be8d2-dfc5-4239-aaee-b5ffe07e5e01 None None] MFA Rules not processed for user `25f43321bcd64cf79795e4168f5f04c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:38.805072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-560be8d2-dfc5-4239-aaee-b5ffe07e5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:38.881242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1078/2163] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:38.882522 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bbdef-53ec-449f-88b9-f909b1bc2a1d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:38.897096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:38.970360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bbdef-53ec-449f-88b9-f909b1bc2a1d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:38.977945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1737c32-9d77-4cc4-af5f-6a2b81ca0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:38.978802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1737c32-9d77-4cc4-af5f-6a2b81ca0195 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:38.979088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1737c32-9d77-4cc4-af5f-6a2b81ca0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:38.979446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1737c32-9d77-4cc4-af5f-6a2b81ca0195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:38.980186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1737c32-9d77-4cc4-af5f-6a2b81ca0195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:38.982673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1737c32-9d77-4cc4-af5f-6a2b81ca0195 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:39.017527 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1086/2164] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:38 2022] POST /identity/v3/projects => generated 409 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:39.020252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560be8d2-dfc5-4239-aaee-b5ffe07e5e01 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:39.031778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560be8d2-dfc5-4239-aaee-b5ffe07e5e01 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:39.108275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2952f-3282-4435-b486-80a27bd379ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:39.109016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2952f-3282-4435-b486-80a27bd379ad admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:39.109454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2952f-3282-4435-b486-80a27bd379ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:39.110124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2952f-3282-4435-b486-80a27bd379ad admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:39.110910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2952f-3282-4435-b486-80a27bd379ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:39.113154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2952f-3282-4435-b486-80a27bd379ad admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:39.141394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1079/2165] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:39 2022] POST /identity/v3/users => generated 311 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:39.146182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1737c32-9d77-4cc4-af5f-6a2b81ca0195 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:39.160097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1737c32-9d77-4cc4-af5f-6a2b81ca0195 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:39.165988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11511786-e1cb-44d6-b443-368cc4fa5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:39.166740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11511786-e1cb-44d6-b443-368cc4fa5079 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:39.167084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11511786-e1cb-44d6-b443-368cc4fa5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:39.167362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11511786-e1cb-44d6-b443-368cc4fa5079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:39.168150 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11511786-e1cb-44d6-b443-368cc4fa5079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:39.169791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11511786-e1cb-44d6-b443-368cc4fa5079 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:39.185416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1087/2166] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:39.186673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2952f-3282-4435-b486-80a27bd379ad admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:39.200504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2952f-3282-4435-b486-80a27bd379ad admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:39.206132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27b8e6-e45e-4905-8c3d-aadd322883d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:39.206896 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b8e6-e45e-4905-8c3d-aadd322883d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:39.207256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b8e6-e45e-4905-8c3d-aadd322883d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:39.207539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b8e6-e45e-4905-8c3d-aadd322883d3 admin admin] PATH_INFO: `/v3/projects/5568501d258c474dac121f0c9fea4df9/users/ba0bf906f5764ce39e36186485ab6921/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:39.228409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27b8e6-e45e-4905-8c3d-aadd322883d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5568501d258c474dac121f0c9fea4df9, user_id=ba0bf906f5764ce39e36186485ab6921, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:39.231885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27b8e6-e45e-4905-8c3d-aadd322883d3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:39.258124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1080/2167] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:39 2022] PUT /identity/v3/projects/5568501d258c474dac121f0c9fea4df9/users/ba0bf906f5764ce39e36186485ab6921/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:39.262242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11511786-e1cb-44d6-b443-368cc4fa5079 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:39.275820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11511786-e1cb-44d6-b443-368cc4fa5079 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:39.345370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a7603-1287-4e59-9cda-b2148fc5acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:39.346018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a7603-1287-4e59-9cda-b2148fc5acf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:39.346305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a7603-1287-4e59-9cda-b2148fc5acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:39.346555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a7603-1287-4e59-9cda-b2148fc5acf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:39.347200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a7603-1287-4e59-9cda-b2148fc5acf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:39.348840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a7603-1287-4e59-9cda-b2148fc5acf8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:39.359518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1088/2168] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:39.363857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27b8e6-e45e-4905-8c3d-aadd322883d3 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:39.374199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27b8e6-e45e-4905-8c3d-aadd322883d3 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:39.378968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:39.379696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:39.380039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:39.380378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] PATH_INFO: `/v3/projects/5568501d258c474dac121f0c9fea4df9/users/ba0bf906f5764ce39e36186485ab6921/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:39.383797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5568501d258c474dac121f0c9fea4df9, user_id=ba0bf906f5764ce39e36186485ab6921, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:39.387117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:39.399927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1081/2169] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:39 2022] PUT /identity/v3/projects/5568501d258c474dac121f0c9fea4df9/users/ba0bf906f5764ce39e36186485ab6921/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:39.412344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608e6cb-641b-49ac-859e-73614ac3a32b None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:39.412632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608e6cb-641b-49ac-859e-73614ac3a32b None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:39.412906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608e6cb-641b-49ac-859e-73614ac3a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:39.446885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e608e6cb-641b-49ac-859e-73614ac3a32b None None] MFA Rules not processed for user `ba0bf906f5764ce39e36186485ab6921`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:39.448180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e608e6cb-641b-49ac-859e-73614ac3a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:39.539308 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:39.546311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1089/2170] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:39.557957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:39.559756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:39.606977 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:39.624220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feced6-5e4d-46e6-8e7c-a020736eb729 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:39.628564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:39.629274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:39.629683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:39.630064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:39.641110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:39.642723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:39.653722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1082/2171] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:39.818152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608e6cb-641b-49ac-859e-73614ac3a32b None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:39.829300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608e6cb-641b-49ac-859e-73614ac3a32b None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:39.833002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cffaf1-a57a-4c71-a903-8081a0d3f362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:39.833660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cffaf1-a57a-4c71-a903-8081a0d3f362 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:39.833940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cffaf1-a57a-4c71-a903-8081a0d3f362 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:39.834212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cffaf1-a57a-4c71-a903-8081a0d3f362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:39.915845 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cffaf1-a57a-4c71-a903-8081a0d3f362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:39.917404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cffaf1-a57a-4c71-a903-8081a0d3f362 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:39.927861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1090/2172] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:39 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:41.429096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:41.432907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:41.535073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6ff95-6766-4f74-a404-40f2e292555f service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:41.540418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:41.541270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:41.541652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:41.541971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] PATH_INFO: `/v3/users/5ceb0f3e22b246d8a3f5ced16295fa80` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:41.543178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ceb0f3e22b246d8a3f5ced16295fa80)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:41.545534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:41.658386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ceb0f3e22b246d8a3f5ced16295fa80'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:41.675066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ceb0f3e22b246d8a3f5ced16295fa80'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:41.676295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ceb0f3e22b246d8a3f5ced16295fa80'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:41.685543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ceb0f3e22b246d8a3f5ced16295fa80'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:41.686344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ceb0f3e22b246d8a3f5ced16295fa80'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:41.701103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1083/2173] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:41 2022] DELETE /identity/v3/users/5ceb0f3e22b246d8a3f5ced16295fa80 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:41.706179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3bf29-cbfa-4eb9-a419-9323a4482c2e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:41.706722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3bf29-cbfa-4eb9-a419-9323a4482c2e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:41.706722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3bf29-cbfa-4eb9-a419-9323a4482c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:41.736669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-31f3bf29-cbfa-4eb9-a419-9323a4482c2e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:41.738321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-31f3bf29-cbfa-4eb9-a419-9323a4482c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:41.810791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1091/2174] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:41.821793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:41.824414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:41.908530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b8aab-b7d2-4b34-8c5b-b42c802733db admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:41.917713 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2464abc-000a-402b-a185-8f383a966ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:41.918347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464abc-000a-402b-a185-8f383a966ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:41.918622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464abc-000a-402b-a185-8f383a966ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:41.918888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464abc-000a-402b-a185-8f383a966ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:41.928977 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2464abc-000a-402b-a185-8f383a966ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:41.930558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2464abc-000a-402b-a185-8f383a966ac2 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:41.940700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1084/2175] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:42.290471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3bf29-cbfa-4eb9-a419-9323a4482c2e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:42.292130 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-31f3bf29-cbfa-4eb9-a419-9323a4482c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:42.304752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3bf29-cbfa-4eb9-a419-9323a4482c2e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:42.331161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:42.331817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:42.332095 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:42.332366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] PATH_INFO: `/v3/projects/5044e322520f485d942885c4ce6554b2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:42.333875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5044e322520f485d942885c4ce6554b2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:42.335798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:42.425171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5044e322520f485d942885c4ce6554b2', 'request_id': 'req-570b3f87-be42-4dc7-a7d6-80d1f5949a10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:42.438643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5044e322520f485d942885c4ce6554b2', 'request_id': 'req-570b3f87-be42-4dc7-a7d6-80d1f5949a10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:42.447171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5044e322520f485d942885c4ce6554b2', 'request_id': 'req-570b3f87-be42-4dc7-a7d6-80d1f5949a10'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:42.467969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] The token cache is being invalidate because project 5044e322520f485d942885c4ce6554b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:42.468298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:42.469767 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-570b3f87-be42-4dc7-a7d6-80d1f5949a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:42.482258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1092/2176] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:42 2022] DELETE /identity/v3/projects/5044e322520f485d942885c4ce6554b2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:42.491450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e463-2c42-42f5-8cb3-e0c8f626094c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:42.492918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e463-2c42-42f5-8cb3-e0c8f626094c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:42.492918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6e463-2c42-42f5-8cb3-e0c8f626094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:42.517968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:42.556394 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-3eb6e463-2c42-42f5-8cb3-e0c8f626094c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:42.559013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3eb6e463-2c42-42f5-8cb3-e0c8f626094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:42.693338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1085/2177] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:05:42.701944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5192c9d-41ce-4e43-b353-12b69c370be2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:42.702218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5192c9d-41ce-4e43-b353-12b69c370be2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:42.702484 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5192c9d-41ce-4e43-b353-12b69c370be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:42.740141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e5192c9d-41ce-4e43-b353-12b69c370be2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:42.742568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e5192c9d-41ce-4e43-b353-12b69c370be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:42.753677 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1093/2178] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:42.755154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e463-2c42-42f5-8cb3-e0c8f626094c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:42.764918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6e463-2c42-42f5-8cb3-e0c8f626094c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:42.769367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:42.769999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:42.770273 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:42.770540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:42.771182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:05:42.771480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:42.773600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:42.784966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1086/2179] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:05:42.790032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5192c9d-41ce-4e43-b353-12b69c370be2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:42.799260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5192c9d-41ce-4e43-b353-12b69c370be2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:42.803868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea76c8-6eb5-469c-9bdd-752a9dc6c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:42.804500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea76c8-6eb5-469c-9bdd-752a9dc6c04e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:42.804773 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea76c8-6eb5-469c-9bdd-752a9dc6c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:42.805042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea76c8-6eb5-469c-9bdd-752a9dc6c04e admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:42.805696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea76c8-6eb5-469c-9bdd-752a9dc6c04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:42.807593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea76c8-6eb5-469c-9bdd-752a9dc6c04e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:42.821980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:42.834948 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1094/2180] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:42 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:42.839428 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:42.849696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3ec8b-e540-4a99-8b39-c1ade7ec05dd admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:42.907839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff102fa-a25e-4606-803a-2e40149de7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:42.908449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff102fa-a25e-4606-803a-2e40149de7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:42.908732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff102fa-a25e-4606-803a-2e40149de7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:42.909001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff102fa-a25e-4606-803a-2e40149de7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:42.909682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff102fa-a25e-4606-803a-2e40149de7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:42.911659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff102fa-a25e-4606-803a-2e40149de7d6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:42.937549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1087/2181] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:42 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:42.941824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea76c8-6eb5-469c-9bdd-752a9dc6c04e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:42.952893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea76c8-6eb5-469c-9bdd-752a9dc6c04e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:42.958007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9984-3e05-4f4a-889b-a48086c7a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:42.958602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9984-3e05-4f4a-889b-a48086c7a158 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:42.958875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9984-3e05-4f4a-889b-a48086c7a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:42.959146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe9984-3e05-4f4a-889b-a48086c7a158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:42.959977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe9984-3e05-4f4a-889b-a48086c7a158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:42.962199 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe9984-3e05-4f4a-889b-a48086c7a158 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:42.983992 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1095/2182] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:05:42.987393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff102fa-a25e-4606-803a-2e40149de7d6 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.004437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff102fa-a25e-4606-803a-2e40149de7d6 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.010030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd315219-5215-441d-8e56-0448eb49a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.010775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd315219-5215-441d-8e56-0448eb49a64c admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.011057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd315219-5215-441d-8e56-0448eb49a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.011325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd315219-5215-441d-8e56-0448eb49a64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.011976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd315219-5215-441d-8e56-0448eb49a64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.013726 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd315219-5215-441d-8e56-0448eb49a64c admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.025219 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1088/2183] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:43.029645 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9984-3e05-4f4a-889b-a48086c7a158 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.045474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe9984-3e05-4f4a-889b-a48086c7a158 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.050942 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a88df-03f7-4bd1-afd8-2bcf502fff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.051755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a88df-03f7-4bd1-afd8-2bcf502fff2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.052047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a88df-03f7-4bd1-afd8-2bcf502fff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.052317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a88df-03f7-4bd1-afd8-2bcf502fff2e admin admin] PATH_INFO: `/v3/projects/40b6101980394b3681ccf005d02d7d15/users/31cebff877e74afb916def79d5b4e035/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.080626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a88df-03f7-4bd1-afd8-2bcf502fff2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b6101980394b3681ccf005d02d7d15, user_id=31cebff877e74afb916def79d5b4e035, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.082698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a88df-03f7-4bd1-afd8-2bcf502fff2e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.119908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1096/2184] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:43 2022] PUT /identity/v3/projects/40b6101980394b3681ccf005d02d7d15/users/31cebff877e74afb916def79d5b4e035/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:43.129245 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d10904-2a0c-4013-bd52-2b4c737b4ccb None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.129561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d10904-2a0c-4013-bd52-2b4c737b4ccb None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.129842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d10904-2a0c-4013-bd52-2b4c737b4ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.160280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d9d10904-2a0c-4013-bd52-2b4c737b4ccb None None] MFA Rules not processed for user `31cebff877e74afb916def79d5b4e035`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:43.161694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d9d10904-2a0c-4013-bd52-2b4c737b4ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:43.263623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:43.271404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1089/2185] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:43.272635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a88df-03f7-4bd1-afd8-2bcf502fff2e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.342400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a88df-03f7-4bd1-afd8-2bcf502fff2e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.347408 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdd60b-9b95-4f7d-baa7-74dcec16615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.348324 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdd60b-9b95-4f7d-baa7-74dcec16615c admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.348644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdd60b-9b95-4f7d-baa7-74dcec16615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.349026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdd60b-9b95-4f7d-baa7-74dcec16615c admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.349833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdd60b-9b95-4f7d-baa7-74dcec16615c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.351907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdd60b-9b95-4f7d-baa7-74dcec16615c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.380265 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1097/2186] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:43 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:43.385142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d10904-2a0c-4013-bd52-2b4c737b4ccb None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.400986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d10904-2a0c-4013-bd52-2b4c737b4ccb None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.473047 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb900d-57d3-4b1a-adbf-620c9c327d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.473706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb900d-57d3-4b1a-adbf-620c9c327d34 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.473988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb900d-57d3-4b1a-adbf-620c9c327d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.474260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb900d-57d3-4b1a-adbf-620c9c327d34 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.474916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb900d-57d3-4b1a-adbf-620c9c327d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.476875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb900d-57d3-4b1a-adbf-620c9c327d34 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.518514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1090/2187] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:43 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:43.525643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdd60b-9b95-4f7d-baa7-74dcec16615c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.538323 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdd60b-9b95-4f7d-baa7-74dcec16615c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.543198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706626cc-2e52-4b7d-ac90-ff21cef09517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.543814 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706626cc-2e52-4b7d-ac90-ff21cef09517 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.544089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706626cc-2e52-4b7d-ac90-ff21cef09517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.544503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706626cc-2e52-4b7d-ac90-ff21cef09517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.545159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706626cc-2e52-4b7d-ac90-ff21cef09517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.546815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706626cc-2e52-4b7d-ac90-ff21cef09517 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.561535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1098/2188] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:43.563486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb900d-57d3-4b1a-adbf-620c9c327d34 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.574972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb900d-57d3-4b1a-adbf-620c9c327d34 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.580057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c319ca-6969-4e3c-bc45-aefc70ecd6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.580721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c319ca-6969-4e3c-bc45-aefc70ecd6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.580997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c319ca-6969-4e3c-bc45-aefc70ecd6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.581380 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c319ca-6969-4e3c-bc45-aefc70ecd6ad admin admin] PATH_INFO: `/v3/projects/a03a91a4187f4aa585ce6c1024da29fe/users/667939f2320146fdbfa0988d5826f920/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.599692 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c319ca-6969-4e3c-bc45-aefc70ecd6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03a91a4187f4aa585ce6c1024da29fe, user_id=667939f2320146fdbfa0988d5826f920, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.602670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c319ca-6969-4e3c-bc45-aefc70ecd6ad admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.627186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1091/2189] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:43 2022] PUT /identity/v3/projects/a03a91a4187f4aa585ce6c1024da29fe/users/667939f2320146fdbfa0988d5826f920/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:43.631233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706626cc-2e52-4b7d-ac90-ff21cef09517 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.642792 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706626cc-2e52-4b7d-ac90-ff21cef09517 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.707435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e283b-079e-4050-889a-4e8f40a37123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.707956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e283b-079e-4050-889a-4e8f40a37123 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.708234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e283b-079e-4050-889a-4e8f40a37123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.708503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e283b-079e-4050-889a-4e8f40a37123 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.709142 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e283b-079e-4050-889a-4e8f40a37123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.710810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e283b-079e-4050-889a-4e8f40a37123 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.720841 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1099/2190] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:43.724931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c319ca-6969-4e3c-bc45-aefc70ecd6ad admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.736422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c319ca-6969-4e3c-bc45-aefc70ecd6ad admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.744697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.745350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.745652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.745927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] PATH_INFO: `/v3/projects/a03a91a4187f4aa585ce6c1024da29fe/users/667939f2320146fdbfa0988d5826f920/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.747832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03a91a4187f4aa585ce6c1024da29fe, user_id=667939f2320146fdbfa0988d5826f920, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.750596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.761447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1092/2191] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:43 2022] PUT /identity/v3/projects/a03a91a4187f4aa585ce6c1024da29fe/users/667939f2320146fdbfa0988d5826f920/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:43.773057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144bb13-ac56-4c52-a6b8-ee78e16e7f6e None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.773686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144bb13-ac56-4c52-a6b8-ee78e16e7f6e None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.773686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144bb13-ac56-4c52-a6b8-ee78e16e7f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.806703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1144bb13-ac56-4c52-a6b8-ee78e16e7f6e None None] MFA Rules not processed for user `667939f2320146fdbfa0988d5826f920`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:43.807946 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1144bb13-ac56-4c52-a6b8-ee78e16e7f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:43.828437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:43.882109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1100/2192] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:43.893145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:43.894855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:43.952580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb0c71-f5ec-4993-bdb0-db19d93906ee admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:43.956119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:43.956711 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:43.956984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:43.957249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:43.966130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:43.967482 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:43.977066 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1093/2193] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:44.051418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144bb13-ac56-4c52-a6b8-ee78e16e7f6e None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:44.061539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144bb13-ac56-4c52-a6b8-ee78e16e7f6e None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:44.065134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3f5a3-1217-42f9-b495-26dca1cf3c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:44.065772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f5a3-1217-42f9-b495-26dca1cf3c25 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:44.066050 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f5a3-1217-42f9-b495-26dca1cf3c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:44.066320 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3f5a3-1217-42f9-b495-26dca1cf3c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:44.121445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3f5a3-1217-42f9-b495-26dca1cf3c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:44.122906 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3f5a3-1217-42f9-b495-26dca1cf3c25 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:44.131565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1101/2194] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:50.640904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:50.642367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:50.702513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:50.709133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d67a0-0a3d-44e5-aa94-c353c4c6b27b service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:50.713971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:50.714589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:50.714869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:50.715140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] PATH_INFO: `/v3/users/25f43321bcd64cf79795e4168f5f04c0` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:50.716258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f43321bcd64cf79795e4168f5f04c0)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:50.718211 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:50.763079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f43321bcd64cf79795e4168f5f04c0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:50.774917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f43321bcd64cf79795e4168f5f04c0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:50.775587 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f43321bcd64cf79795e4168f5f04c0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:50.782247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f43321bcd64cf79795e4168f5f04c0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:50.782834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f43321bcd64cf79795e4168f5f04c0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:50.795664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1094/2195] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:50 2022] DELETE /identity/v3/users/25f43321bcd64cf79795e4168f5f04c0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:50.800161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344189a2-d06b-4274-abc7-4c9e96d4d377 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:50.800626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344189a2-d06b-4274-abc7-4c9e96d4d377 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:50.800730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344189a2-d06b-4274-abc7-4c9e96d4d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:50.821043 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-344189a2-d06b-4274-abc7-4c9e96d4d377 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:50.822283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-344189a2-d06b-4274-abc7-4c9e96d4d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:50.883391 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1102/2196] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:50.894368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:50.895807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:50.958635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12e69d-7c28-4822-ac29-2f3b9f0c79a3 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:50.963041 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cc2cd-f569-4ab8-bc19-99ea90b164ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:50.963972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cc2cd-f569-4ab8-bc19-99ea90b164ee service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:50.964265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cc2cd-f569-4ab8-bc19-99ea90b164ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:50.964509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cc2cd-f569-4ab8-bc19-99ea90b164ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:50.974743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cc2cd-f569-4ab8-bc19-99ea90b164ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:50.976056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cc2cd-f569-4ab8-bc19-99ea90b164ee service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:50.989568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1095/2197] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:51.272685 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344189a2-d06b-4274-abc7-4c9e96d4d377 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:51.274876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-344189a2-d06b-4274-abc7-4c9e96d4d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:51.290470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344189a2-d06b-4274-abc7-4c9e96d4d377 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:51.295156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:51.296020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:51.296464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:51.296880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] PATH_INFO: `/v3/projects/c8de45680f964779981727737f86b422` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:51.298911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8de45680f964779981727737f86b422)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:51.301108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:51.355539 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:51.357919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8de45680f964779981727737f86b422', 'request_id': 'req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.365110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8de45680f964779981727737f86b422', 'request_id': 'req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.372362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8de45680f964779981727737f86b422', 'request_id': 'req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.385821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] The token cache is being invalidate because project c8de45680f964779981727737f86b422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:51.386109 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.386725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.388212 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1103/2198] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:51 2022] DELETE /identity/v3/projects/c8de45680f964779981727737f86b422 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:51.392182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cc2cd-f569-4ab8-bc19-99ea90b164ee service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:51.402804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cc2cd-f569-4ab8-bc19-99ea90b164ee service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:51.459596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:51.460220 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:51.461234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:51.461529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] PATH_INFO: `/v3/users/ba0bf906f5764ce39e36186485ab6921` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:51.462744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0bf906f5764ce39e36186485ab6921)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:51.464740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:51.486953 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:51.520162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0bf906f5764ce39e36186485ab6921'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.532230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0bf906f5764ce39e36186485ab6921'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.532883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0bf906f5764ce39e36186485ab6921'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.539414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0bf906f5764ce39e36186485ab6921'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.540037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4cccaaef-14af-47e6-bbda-43a64346482d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0bf906f5764ce39e36186485ab6921'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.552101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1096/2199] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:51 2022] DELETE /identity/v3/users/ba0bf906f5764ce39e36186485ab6921 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:51.840289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:51.841853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:51.855646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d39cc-867f-48eb-9dd9-c778e4c61f23 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:51.920935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:51.921755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:51.922029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:51.922295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] PATH_INFO: `/v3/projects/5568501d258c474dac121f0c9fea4df9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:51.923418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5568501d258c474dac121f0c9fea4df9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:51.925334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:51.986088 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5568501d258c474dac121f0c9fea4df9', 'request_id': 'req-e3170aaa-2fc1-46a6-b731-190181322a44'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:51.993278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5568501d258c474dac121f0c9fea4df9', 'request_id': 'req-e3170aaa-2fc1-46a6-b731-190181322a44'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:52.000008 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5568501d258c474dac121f0c9fea4df9', 'request_id': 'req-e3170aaa-2fc1-46a6-b731-190181322a44'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:52.013569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] The token cache is being invalidate because project 5568501d258c474dac121f0c9fea4df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:52.013943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:52.014609 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-e3170aaa-2fc1-46a6-b731-190181322a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:52.016110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1104/2200] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:51 2022] DELETE /identity/v3/projects/5568501d258c474dac121f0c9fea4df9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:52.021104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997338-210c-4ee0-a3ba-025d587ea2d0 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.021629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997338-210c-4ee0-a3ba-025d587ea2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.021813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19997338-210c-4ee0-a3ba-025d587ea2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.042895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-19997338-210c-4ee0-a3ba-025d587ea2d0 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:52.044252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-19997338-210c-4ee0-a3ba-025d587ea2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:52.121629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1097/2201] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:52.129089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181dcc2-d956-4469-978b-3d7e2f898ffc None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.129512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181dcc2-d956-4469-978b-3d7e2f898ffc None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.129851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181dcc2-d956-4469-978b-3d7e2f898ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.151532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-8181dcc2-d956-4469-978b-3d7e2f898ffc None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:52.153422 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8181dcc2-d956-4469-978b-3d7e2f898ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:52.161312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1105/2202] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:52.166118 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19997338-210c-4ee0-a3ba-025d587ea2d0 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:52.175899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19997338-210c-4ee0-a3ba-025d587ea2d0 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:52.181134 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:52.181767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.182045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.182317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.182966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:05:52.183272 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:52.184858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:52.196446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1098/2203] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:05:52.200810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181dcc2-d956-4469-978b-3d7e2f898ffc None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:52.209940 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181dcc2-d956-4469-978b-3d7e2f898ffc None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:52.214643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96194-38bf-4f12-8401-c2b74f99f682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:52.215239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96194-38bf-4f12-8401-c2b74f99f682 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.215516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96194-38bf-4f12-8401-c2b74f99f682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.215809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd96194-38bf-4f12-8401-c2b74f99f682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.216505 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd96194-38bf-4f12-8401-c2b74f99f682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:52.218459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd96194-38bf-4f12-8401-c2b74f99f682 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:52.247029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1106/2204] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:52 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:05:52.251256 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:52.261053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017355d-643a-4edd-b9bc-3b0f71f1e6e6 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:52.317882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdf47-4f04-4fbd-84d6-e01302b230cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:52.318406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdf47-4f04-4fbd-84d6-e01302b230cc admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.318686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdf47-4f04-4fbd-84d6-e01302b230cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.318960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebdf47-4f04-4fbd-84d6-e01302b230cc admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.319600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebdf47-4f04-4fbd-84d6-e01302b230cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:52.321540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebdf47-4f04-4fbd-84d6-e01302b230cc admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:52.342072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1099/2205] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:52 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:52.346309 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96194-38bf-4f12-8401-c2b74f99f682 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:52.356976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd96194-38bf-4f12-8401-c2b74f99f682 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:52.361853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aacb6-8f35-4e5f-ab6e-7dc15c5d7160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:52.362449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aacb6-8f35-4e5f-ab6e-7dc15c5d7160 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.362727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aacb6-8f35-4e5f-ab6e-7dc15c5d7160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.363002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6aacb6-8f35-4e5f-ab6e-7dc15c5d7160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.363667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aacb6-8f35-4e5f-ab6e-7dc15c5d7160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:52.365272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6aacb6-8f35-4e5f-ab6e-7dc15c5d7160 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:52.379458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1107/2206] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:52.380415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdf47-4f04-4fbd-84d6-e01302b230cc admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:52.390449 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebdf47-4f04-4fbd-84d6-e01302b230cc admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:52.395233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd0d10-0a5a-4e84-ae81-7b584253da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:52.395830 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd0d10-0a5a-4e84-ae81-7b584253da6b admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.396112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd0d10-0a5a-4e84-ae81-7b584253da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.396379 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd0d10-0a5a-4e84-ae81-7b584253da6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.397019 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd0d10-0a5a-4e84-ae81-7b584253da6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:52.398675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd0d10-0a5a-4e84-ae81-7b584253da6b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:52.408738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1100/2207] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:05:52.413020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aacb6-8f35-4e5f-ab6e-7dc15c5d7160 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:52.423865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6aacb6-8f35-4e5f-ab6e-7dc15c5d7160 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:52.428571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:52.429291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.430115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.430420 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] PATH_INFO: `/v3/projects/d79493455fcd4feabbbecbe929e0f5fc/users/75c10f4846c2498e8cc93a3c3c5ecdd9/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.446127 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79493455fcd4feabbbecbe929e0f5fc, user_id=75c10f4846c2498e8cc93a3c3c5ecdd9, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:52.448843 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:52.462628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1108/2208] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:52 2022] PUT /identity/v3/projects/d79493455fcd4feabbbecbe929e0f5fc/users/75c10f4846c2498e8cc93a3c3c5ecdd9/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:52.467614 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa676-16ee-4d85-8aa5-c918194a1833 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.467902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa676-16ee-4d85-8aa5-c918194a1833 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.468209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa676-16ee-4d85-8aa5-c918194a1833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.475327 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:52.491285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0a0fa676-16ee-4d85-8aa5-c918194a1833 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:52.492683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0a0fa676-16ee-4d85-8aa5-c918194a1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:52.569411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1101/2209] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:52.578917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:52.580774 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:52.586786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:52.640549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cacf1b-6bb9-400a-bc01-d8f313ab0ae5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:52.644188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b6848-2bd6-421f-9ddf-e9a82e41e892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:52.644799 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b6848-2bd6-421f-9ddf-e9a82e41e892 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:52.645075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b6848-2bd6-421f-9ddf-e9a82e41e892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:52.645353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b6848-2bd6-421f-9ddf-e9a82e41e892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:52.655271 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b6848-2bd6-421f-9ddf-e9a82e41e892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:52.656723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b6848-2bd6-421f-9ddf-e9a82e41e892 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:52.667221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1109/2210] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:53.104091 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa676-16ee-4d85-8aa5-c918194a1833 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:53.105625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0a0fa676-16ee-4d85-8aa5-c918194a1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:53.118037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa676-16ee-4d85-8aa5-c918194a1833 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:53.123100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:53.123722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:53.123995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:53.124266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] PATH_INFO: `/v3/users/31cebff877e74afb916def79d5b4e035` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:53.125529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cebff877e74afb916def79d5b4e035)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:53.127442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:53.177060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cebff877e74afb916def79d5b4e035'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:53.189105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cebff877e74afb916def79d5b4e035'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:53.189821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cebff877e74afb916def79d5b4e035'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:53.197775 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cebff877e74afb916def79d5b4e035'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:53.198436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cebff877e74afb916def79d5b4e035'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:53.212180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1102/2211] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:53 2022] DELETE /identity/v3/users/31cebff877e74afb916def79d5b4e035 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:53.216803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28205-6a5c-43f5-b5f9-573d6fa3affb None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:53.217281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28205-6a5c-43f5-b5f9-573d6fa3affb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:53.217393 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb28205-6a5c-43f5-b5f9-573d6fa3affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:53.236588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7eb28205-6a5c-43f5-b5f9-573d6fa3affb None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:53.237830 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7eb28205-6a5c-43f5-b5f9-573d6fa3affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:53.297740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1110/2212] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:53.308125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:53.309689 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:53.370717 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24caf1b8-1239-4a25-9690-26734da0be9b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:53.374550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c29711-0c2b-4604-aeeb-e29967ad6b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:53.375251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29711-0c2b-4604-aeeb-e29967ad6b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:53.375462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29711-0c2b-4604-aeeb-e29967ad6b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:53.375757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29711-0c2b-4604-aeeb-e29967ad6b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:53.386080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c29711-0c2b-4604-aeeb-e29967ad6b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:53.387539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c29711-0c2b-4604-aeeb-e29967ad6b75 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:53.397291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1103/2213] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:53.817041 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb28205-6a5c-43f5-b5f9-573d6fa3affb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:53.819094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7eb28205-6a5c-43f5-b5f9-573d6fa3affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:53.836395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb28205-6a5c-43f5-b5f9-573d6fa3affb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:53.866207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:53.867609 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:53.868401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:53.869118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] PATH_INFO: `/v3/projects/40b6101980394b3681ccf005d02d7d15` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:53.870669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b6101980394b3681ccf005d02d7d15)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:53.873119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:53.959251 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b6101980394b3681ccf005d02d7d15', 'request_id': 'req-74846179-368a-4c15-b107-e8e7cf7d63b8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:53.968756 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b6101980394b3681ccf005d02d7d15', 'request_id': 'req-74846179-368a-4c15-b107-e8e7cf7d63b8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:53.988192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879189e5-c539-4aaf-99af-543922ac41b3 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:53.988683 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879189e5-c539-4aaf-99af-543922ac41b3 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:53.989110 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879189e5-c539-4aaf-99af-543922ac41b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:54.002005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b6101980394b3681ccf005d02d7d15', 'request_id': 'req-74846179-368a-4c15-b107-e8e7cf7d63b8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:54.019003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-879189e5-c539-4aaf-99af-543922ac41b3 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:54.020501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-879189e5-c539-4aaf-99af-543922ac41b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:54.031086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] The token cache is being invalidate because project 40b6101980394b3681ccf005d02d7d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:54.032116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:54.032930 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:54.035211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1111/2214] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:53 2022] DELETE /identity/v3/projects/40b6101980394b3681ccf005d02d7d15 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:54.040450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:54.044071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:54.078527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:54.148752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:54.166897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1104/2215] 10.222.0.47 () {58 vars in 967 bytes} [Fri Oct 14 13:05:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:05:54.183298 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879189e5-c539-4aaf-99af-543922ac41b3 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:54.186007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-879189e5-c539-4aaf-99af-543922ac41b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:54.203925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74846179-368a-4c15-b107-e8e7cf7d63b8 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:54.209409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:54.211186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:54.211564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:54.211939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] PATH_INFO: `/v3/users/667939f2320146fdbfa0988d5826f920` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:54.217979 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667939f2320146fdbfa0988d5826f920)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:54.220853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:54.315413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667939f2320146fdbfa0988d5826f920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:54.331310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667939f2320146fdbfa0988d5826f920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:54.332755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667939f2320146fdbfa0988d5826f920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:54.344713 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667939f2320146fdbfa0988d5826f920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:54.346494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667939f2320146fdbfa0988d5826f920'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:54.371353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1112/2216] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:05:54 2022] DELETE /identity/v3/users/667939f2320146fdbfa0988d5826f920 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:54.382694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879189e5-c539-4aaf-99af-543922ac41b3 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:54.529205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:54.529858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:54.530139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:54.530405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:54.532287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:54.697593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:54.699229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:54.721811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1105/2217] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:05:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:55.115509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:55.117553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:55.151838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:55.153687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:55.196550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:55.326861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643519-e606-45ab-95f4-c1bff66ac258 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:55.336234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5f47a-7883-4b70-bd94-483d906f4e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:55.337853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f47a-7883-4b70-bd94-483d906f4e4f service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:55.338348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f47a-7883-4b70-bd94-483d906f4e4f service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:55.338793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f47a-7883-4b70-bd94-483d906f4e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:55.341311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-53b5f47a-7883-4b70-bd94-483d906f4e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:55.373677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23b98-d83c-4064-bc6c-51ba9a9f386c service swift] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:55.384652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:55.386312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:55.386759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:55.387837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] PATH_INFO: `/v3/projects/a03a91a4187f4aa585ce6c1024da29fe` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:55.390231 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03a91a4187f4aa585ce6c1024da29fe)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:55.396328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:55.449764 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:55.474057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5f47a-7883-4b70-bd94-483d906f4e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:55.475789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5f47a-7883-4b70-bd94-483d906f4e4f service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:55.504875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1113/2218] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:55.516154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03a91a4187f4aa585ce6c1024da29fe', 'request_id': 'req-d5e4aac1-33ae-4e65-8721-374d75616b6e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:55.525568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03a91a4187f4aa585ce6c1024da29fe', 'request_id': 'req-d5e4aac1-33ae-4e65-8721-374d75616b6e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:55.533448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03a91a4187f4aa585ce6c1024da29fe', 'request_id': 'req-d5e4aac1-33ae-4e65-8721-374d75616b6e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:55.552645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] The token cache is being invalidate because project a03a91a4187f4aa585ce6c1024da29fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:05:55.553123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:55.553709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d5e4aac1-33ae-4e65-8721-374d75616b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:05:55.557541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1106/2219] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:05:55 2022] DELETE /identity/v3/projects/a03a91a4187f4aa585ce6c1024da29fe => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:55.561379 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320593e4-a0f1-4983-aa08-a9e9d50ff4d1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:55.562007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320593e4-a0f1-4983-aa08-a9e9d50ff4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:55.562285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320593e4-a0f1-4983-aa08-a9e9d50ff4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:55.584462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-320593e4-a0f1-4983-aa08-a9e9d50ff4d1 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:55.585868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-320593e4-a0f1-4983-aa08-a9e9d50ff4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:55.670466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1114/2220] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:55.679744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21442f5-6677-4851-bb0c-2f8258141c48 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:55.680032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21442f5-6677-4851-bb0c-2f8258141c48 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:55.680311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21442f5-6677-4851-bb0c-2f8258141c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:55.704870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d21442f5-6677-4851-bb0c-2f8258141c48 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:55.706140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d21442f5-6677-4851-bb0c-2f8258141c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:55.715898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1107/2221] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:55.723262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320593e4-a0f1-4983-aa08-a9e9d50ff4d1 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:55.736917 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320593e4-a0f1-4983-aa08-a9e9d50ff4d1 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:55.741898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:55.742593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:55.742880 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:55.743154 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:55.743815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:05:55.744117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:55.745872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:55.759358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1115/2222] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:05:55.763453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21442f5-6677-4851-bb0c-2f8258141c48 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:55.773859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21442f5-6677-4851-bb0c-2f8258141c48 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:55.786719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b23104-dd01-4b13-8070-de3407f82c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:55.787322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23104-dd01-4b13-8070-de3407f82c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:55.787599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23104-dd01-4b13-8070-de3407f82c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:55.787878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23104-dd01-4b13-8070-de3407f82c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:55.789088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b23104-dd01-4b13-8070-de3407f82c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:55.791046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b23104-dd01-4b13-8070-de3407f82c29 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:55.829527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1108/2223] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:55 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:05:55.833700 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:55.845431 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777d02b-7075-47c7-83cf-cf2169fbfae7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:55.935501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca373-ed7e-4562-b94d-427cf5e3eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:55.936469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca373-ed7e-4562-b94d-427cf5e3eb8d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:55.936913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca373-ed7e-4562-b94d-427cf5e3eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:55.937339 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca373-ed7e-4562-b94d-427cf5e3eb8d admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:55.938182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca373-ed7e-4562-b94d-427cf5e3eb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:55.940647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca373-ed7e-4562-b94d-427cf5e3eb8d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:55.977601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1116/2224] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:55 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:55.982936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b23104-dd01-4b13-8070-de3407f82c29 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:56.000131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b23104-dd01-4b13-8070-de3407f82c29 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:56.008136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fb5c-077b-473e-b993-03793510dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:56.008772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fb5c-077b-473e-b993-03793510dbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:56.009051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fb5c-077b-473e-b993-03793510dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:56.009320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3fb5c-077b-473e-b993-03793510dbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:56.010032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3fb5c-077b-473e-b993-03793510dbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:56.011619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3fb5c-077b-473e-b993-03793510dbb4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:56.033370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1109/2225] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:56.034633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca373-ed7e-4562-b94d-427cf5e3eb8d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:56.045704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca373-ed7e-4562-b94d-427cf5e3eb8d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:56.061708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbee6-ff7c-4aa9-8034-3b0cc3edf6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:56.062531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbee6-ff7c-4aa9-8034-3b0cc3edf6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:56.062991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbee6-ff7c-4aa9-8034-3b0cc3edf6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:56.063421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbee6-ff7c-4aa9-8034-3b0cc3edf6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:56.064240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dbee6-ff7c-4aa9-8034-3b0cc3edf6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:56.066541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dbee6-ff7c-4aa9-8034-3b0cc3edf6fb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:56.082544 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1117/2226] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:56.083750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fb5c-077b-473e-b993-03793510dbb4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:56.097172 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3fb5c-077b-473e-b993-03793510dbb4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:56.103904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c9c8a-122c-47c5-b978-a0e6d0055c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:56.104599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c9c8a-122c-47c5-b978-a0e6d0055c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:56.104979 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c9c8a-122c-47c5-b978-a0e6d0055c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:56.105150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c9c8a-122c-47c5-b978-a0e6d0055c18 admin admin] PATH_INFO: `/v3/projects/f117bf166fbe453e80a3df2bc257a9f9/users/db9ac01e43204335a62460fa328913f5/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:56.143901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c9c8a-122c-47c5-b978-a0e6d0055c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f117bf166fbe453e80a3df2bc257a9f9, user_id=db9ac01e43204335a62460fa328913f5, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:56.146633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c9c8a-122c-47c5-b978-a0e6d0055c18 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:56.179717 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1110/2227] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:56 2022] PUT /identity/v3/projects/f117bf166fbe453e80a3df2bc257a9f9/users/db9ac01e43204335a62460fa328913f5/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:05:56.191622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5f737-e5b0-490a-814f-1c39dc47488d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:56.192714 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5f737-e5b0-490a-814f-1c39dc47488d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:56.193146 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5f737-e5b0-490a-814f-1c39dc47488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:56.237427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cba5f737-e5b0-490a-814f-1c39dc47488d None None] MFA Rules not processed for user `db9ac01e43204335a62460fa328913f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:56.238867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cba5f737-e5b0-490a-814f-1c39dc47488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:56.324231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:56.381176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1118/2228] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:56.385367 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c9c8a-122c-47c5-b978-a0e6d0055c18 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:56.475043 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:56.523300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c9c8a-122c-47c5-b978-a0e6d0055c18 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:56.530832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6356c-c949-40ea-a5d8-a75020375989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:56.531868 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6356c-c949-40ea-a5d8-a75020375989 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:56.532365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6356c-c949-40ea-a5d8-a75020375989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:56.532875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6356c-c949-40ea-a5d8-a75020375989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:56.533911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6356c-c949-40ea-a5d8-a75020375989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:56.536636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c6356c-c949-40ea-a5d8-a75020375989 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:56.575067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1111/2229] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:56 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:05:56.578867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5f737-e5b0-490a-814f-1c39dc47488d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:56.592763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5f737-e5b0-490a-814f-1c39dc47488d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:56.686655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215708a-c53e-45d6-8d07-6e084ec9d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:56.687329 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215708a-c53e-45d6-8d07-6e084ec9d6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:56.688079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215708a-c53e-45d6-8d07-6e084ec9d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:56.688361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215708a-c53e-45d6-8d07-6e084ec9d6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:56.689310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215708a-c53e-45d6-8d07-6e084ec9d6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:56.691499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215708a-c53e-45d6-8d07-6e084ec9d6f5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:56.722316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1119/2230] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:56 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:56.726595 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6356c-c949-40ea-a5d8-a75020375989 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:56.742263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6356c-c949-40ea-a5d8-a75020375989 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:56.750928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d31bb-7273-413f-9977-cc5fc7169723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:56.751956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d31bb-7273-413f-9977-cc5fc7169723 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:56.752305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d31bb-7273-413f-9977-cc5fc7169723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:56.752645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d31bb-7273-413f-9977-cc5fc7169723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:56.754600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d31bb-7273-413f-9977-cc5fc7169723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:56.756882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d31bb-7273-413f-9977-cc5fc7169723 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:56.775504 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1112/2231] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:05:56.779365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215708a-c53e-45d6-8d07-6e084ec9d6f5 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:56.795052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215708a-c53e-45d6-8d07-6e084ec9d6f5 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:56.803186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69271a-87f5-4b25-b020-5a9d266d122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:56.804007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69271a-87f5-4b25-b020-5a9d266d122b admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:56.804388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69271a-87f5-4b25-b020-5a9d266d122b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:56.804783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69271a-87f5-4b25-b020-5a9d266d122b admin admin] PATH_INFO: `/v3/projects/4d8d85eea1344d03bf13c75a69015a12/users/bfcc364df66b4c50b5206128e6a999b3/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:56.831326 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69271a-87f5-4b25-b020-5a9d266d122b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8d85eea1344d03bf13c75a69015a12, user_id=bfcc364df66b4c50b5206128e6a999b3, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:56.835966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69271a-87f5-4b25-b020-5a9d266d122b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:56.855611 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1120/2232] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:56 2022] PUT /identity/v3/projects/4d8d85eea1344d03bf13c75a69015a12/users/bfcc364df66b4c50b5206128e6a999b3/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:56.862094 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d31bb-7273-413f-9977-cc5fc7169723 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:56.875448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d31bb-7273-413f-9977-cc5fc7169723 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:57.037026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377cfe8-aea9-47e9-a36f-f22f82df1de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:57.037703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377cfe8-aea9-47e9-a36f-f22f82df1de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:57.037988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377cfe8-aea9-47e9-a36f-f22f82df1de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:57.038266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377cfe8-aea9-47e9-a36f-f22f82df1de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:57.038934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377cfe8-aea9-47e9-a36f-f22f82df1de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:57.041169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377cfe8-aea9-47e9-a36f-f22f82df1de1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:57.074559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1113/2233] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:57.075583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69271a-87f5-4b25-b020-5a9d266d122b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:57.091377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69271a-87f5-4b25-b020-5a9d266d122b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:57.106529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:57.107454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:57.107907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:57.108333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] PATH_INFO: `/v3/projects/4d8d85eea1344d03bf13c75a69015a12/users/bfcc364df66b4c50b5206128e6a999b3/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:57.111768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8d85eea1344d03bf13c75a69015a12, user_id=bfcc364df66b4c50b5206128e6a999b3, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:57.114941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:57.132839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1121/2234] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:57 2022] PUT /identity/v3/projects/4d8d85eea1344d03bf13c75a69015a12/users/bfcc364df66b4c50b5206128e6a999b3/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:57.143246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a413ea-8273-4b79-869f-d24405c75836 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:57.143524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a413ea-8273-4b79-869f-d24405c75836 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:57.143834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a413ea-8273-4b79-869f-d24405c75836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:57.212731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-98a413ea-8273-4b79-869f-d24405c75836 None None] MFA Rules not processed for user `bfcc364df66b4c50b5206128e6a999b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:57.214056 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-98a413ea-8273-4b79-869f-d24405c75836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:57.317880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1114/2235] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:57.331500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:57.333286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:57.413113 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47202ed-15c4-41e1-a31e-58e7453c5075 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:57.424857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ad3df-26da-48d7-ac7d-586deeca1b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:57.425731 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ad3df-26da-48d7-ac7d-586deeca1b7f service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:57.426330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ad3df-26da-48d7-ac7d-586deeca1b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:57.426841 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ad3df-26da-48d7-ac7d-586deeca1b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:57.449569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ad3df-26da-48d7-ac7d-586deeca1b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:57.451112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ad3df-26da-48d7-ac7d-586deeca1b7f service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:57.475488 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1122/2236] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:57.588545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a413ea-8273-4b79-869f-d24405c75836 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:57.602613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a413ea-8273-4b79-869f-d24405c75836 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:57.614513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:57.615185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:57.615462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:57.615725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:57.654940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:57.705951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:57.707793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:57.728138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1115/2237] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:58.787278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05fc7-be3e-4a85-a367-16190a1159b3 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:58.787763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05fc7-be3e-4a85-a367-16190a1159b3 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:58.787943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05fc7-be3e-4a85-a367-16190a1159b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:58.819067 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bac05fc7-be3e-4a85-a367-16190a1159b3 None None] MFA Rules not processed for user `75c10f4846c2498e8cc93a3c3c5ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:58.820377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bac05fc7-be3e-4a85-a367-16190a1159b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:58.850868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:58.905072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1123/2238] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:58.908940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:58.912269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:59.000229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171541ba-3d27-4cf5-880c-0c9a4114ac45 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:59.005398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6c118-74fe-475e-89e0-7f4eee30ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:59.006221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6c118-74fe-475e-89e0-7f4eee30ab00 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:59.006563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6c118-74fe-475e-89e0-7f4eee30ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:59.006909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6c118-74fe-475e-89e0-7f4eee30ab00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:59.008134 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6c118-74fe-475e-89e0-7f4eee30ab00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:59.011188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6c118-74fe-475e-89e0-7f4eee30ab00 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:59.048138 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1116/2239] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:05:58 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:59.052248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac05fc7-be3e-4a85-a367-16190a1159b3 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:59.072264 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac05fc7-be3e-4a85-a367-16190a1159b3 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:59.139733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf5338-b9f2-4ea5-a4c4-9a1b451005ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:59.140215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5338-b9f2-4ea5-a4c4-9a1b451005ff admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:59.140567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5338-b9f2-4ea5-a4c4-9a1b451005ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:59.140760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5338-b9f2-4ea5-a4c4-9a1b451005ff admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:59.141402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf5338-b9f2-4ea5-a4c4-9a1b451005ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:59.143654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf5338-b9f2-4ea5-a4c4-9a1b451005ff admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:59.167535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1124/2240] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:05:59 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:05:59.171161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6c118-74fe-475e-89e0-7f4eee30ab00 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:59.182602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6c118-74fe-475e-89e0-7f4eee30ab00 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:59.187566 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7aa490-9aa5-4c4e-99ee-ba6bdea03e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:59.188124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aa490-9aa5-4c4e-99ee-ba6bdea03e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:59.188404 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aa490-9aa5-4c4e-99ee-ba6bdea03e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:59.188740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7aa490-9aa5-4c4e-99ee-ba6bdea03e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:59.189318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7aa490-9aa5-4c4e-99ee-ba6bdea03e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:59.190983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7aa490-9aa5-4c4e-99ee-ba6bdea03e9a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:59.204398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1117/2241] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:59.208932 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf5338-b9f2-4ea5-a4c4-9a1b451005ff admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:59.221017 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf5338-b9f2-4ea5-a4c4-9a1b451005ff admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:59.226619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff29ee5-d22d-4fab-96ef-33889d6c2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:59.227277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff29ee5-d22d-4fab-96ef-33889d6c2ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:59.227549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff29ee5-d22d-4fab-96ef-33889d6c2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:59.228944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff29ee5-d22d-4fab-96ef-33889d6c2ef6 admin admin] PATH_INFO: `/v3/projects/c15ad422b1f447dba44418576bd18d6f/users/77390850abe64c2782654fcd01434ff7/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:59.248581 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff29ee5-d22d-4fab-96ef-33889d6c2ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15ad422b1f447dba44418576bd18d6f, user_id=77390850abe64c2782654fcd01434ff7, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:59.251463 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff29ee5-d22d-4fab-96ef-33889d6c2ef6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:59.267374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1125/2242] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:59 2022] PUT /identity/v3/projects/c15ad422b1f447dba44418576bd18d6f/users/77390850abe64c2782654fcd01434ff7/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:05:59.271166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7aa490-9aa5-4c4e-99ee-ba6bdea03e9a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:59.281736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7aa490-9aa5-4c4e-99ee-ba6bdea03e9a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:59.338770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3573bf-e142-47a2-ad32-3441bb360d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:59.339377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3573bf-e142-47a2-ad32-3441bb360d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:59.339654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3573bf-e142-47a2-ad32-3441bb360d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:59.339923 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3573bf-e142-47a2-ad32-3441bb360d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:59.340564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3573bf-e142-47a2-ad32-3441bb360d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:59.342181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3573bf-e142-47a2-ad32-3441bb360d0f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:59.352363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1118/2243] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:05:59.356555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff29ee5-d22d-4fab-96ef-33889d6c2ef6 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:59.370454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff29ee5-d22d-4fab-96ef-33889d6c2ef6 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:59.375065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e555c6-f950-4b37-8cf1-9307e9bf4bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:59.375712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e555c6-f950-4b37-8cf1-9307e9bf4bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:59.375987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e555c6-f950-4b37-8cf1-9307e9bf4bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:59.376258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e555c6-f950-4b37-8cf1-9307e9bf4bf5 admin admin] PATH_INFO: `/v3/projects/c15ad422b1f447dba44418576bd18d6f/users/77390850abe64c2782654fcd01434ff7/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:59.378210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e555c6-f950-4b37-8cf1-9307e9bf4bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15ad422b1f447dba44418576bd18d6f, user_id=77390850abe64c2782654fcd01434ff7, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:59.382102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e555c6-f950-4b37-8cf1-9307e9bf4bf5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:59.393247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1126/2244] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:05:59 2022] PUT /identity/v3/projects/c15ad422b1f447dba44418576bd18d6f/users/77390850abe64c2782654fcd01434ff7/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:00.627151 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3573bf-e142-47a2-ad32-3441bb360d0f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:00.638148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3573bf-e142-47a2-ad32-3441bb360d0f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:00.682288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:00.714257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:00.714921 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:00.715205 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:00.715482 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] PATH_INFO: `/v3/users/db9ac01e43204335a62460fa328913f5` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:00.716643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9ac01e43204335a62460fa328913f5)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:00.718814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:00.777787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9ac01e43204335a62460fa328913f5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:00.794684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9ac01e43204335a62460fa328913f5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:00.795895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9ac01e43204335a62460fa328913f5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:00.807088 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9ac01e43204335a62460fa328913f5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:00.807890 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9ac01e43204335a62460fa328913f5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:00.831931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1119/2245] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:00 2022] DELETE /identity/v3/users/db9ac01e43204335a62460fa328913f5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:00.836837 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8b29-8ec7-4255-95ef-500ceb6be87d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:00.837328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8b29-8ec7-4255-95ef-500ceb6be87d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:00.837328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8b29-8ec7-4255-95ef-500ceb6be87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:00.858287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-59fb8b29-8ec7-4255-95ef-500ceb6be87d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:00.859509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-59fb8b29-8ec7-4255-95ef-500ceb6be87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:00.926413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1127/2246] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:00.966037 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:00.967781 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:01.044813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de90788-e6b0-4f4f-b5f5-0b6a6aeb0bf8 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:01.049590 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:01.050448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:01.050910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:01.051295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:01.062764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:01.064299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:01.075181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1120/2247] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:01.508457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb8b29-8ec7-4255-95ef-500ceb6be87d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:01.510193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-59fb8b29-8ec7-4255-95ef-500ceb6be87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:01.522695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb8b29-8ec7-4255-95ef-500ceb6be87d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:01.527225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:01.527935 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:01.528424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:01.529015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:01.531322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:01.544355 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:01.545967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:01.559623 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1128/2248] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:02.026744 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:02.028875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:02.046181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0a9fb-028f-4a21-adbb-95a6415cb678 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:02.059000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:02.059831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:02.060285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:02.060722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] PATH_INFO: `/v3/projects/f117bf166fbe453e80a3df2bc257a9f9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:02.064184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f117bf166fbe453e80a3df2bc257a9f9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:02.066420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:02.146382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f117bf166fbe453e80a3df2bc257a9f9', 'request_id': 'req-16bb1b29-3341-49e4-adb6-52edb4491b07'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.157825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:02.160588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f117bf166fbe453e80a3df2bc257a9f9', 'request_id': 'req-16bb1b29-3341-49e4-adb6-52edb4491b07'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.174001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f117bf166fbe453e80a3df2bc257a9f9', 'request_id': 'req-16bb1b29-3341-49e4-adb6-52edb4491b07'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.203660 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] The token cache is being invalidate because project f117bf166fbe453e80a3df2bc257a9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:02.203966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.204642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.206522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1121/2249] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:02 2022] DELETE /identity/v3/projects/f117bf166fbe453e80a3df2bc257a9f9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:02.211126 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:02.221373 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:02.228350 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e8f14-b037-4bc5-9b15-0745370b6330 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:02.354772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:02.355432 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:02.355705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:02.355975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] PATH_INFO: `/v3/users/bfcc364df66b4c50b5206128e6a999b3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:02.358100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcc364df66b4c50b5206128e6a999b3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:02.361965 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:02.459416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcc364df66b4c50b5206128e6a999b3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.490274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcc364df66b4c50b5206128e6a999b3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.492559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcc364df66b4c50b5206128e6a999b3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.502947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcc364df66b4c50b5206128e6a999b3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.503599 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-91f028d3-c71c-4cac-b75b-ec8f532f6292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcc364df66b4c50b5206128e6a999b3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:02.522252 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1129/2250] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:02 2022] DELETE /identity/v3/users/bfcc364df66b4c50b5206128e6a999b3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:03.620244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:03.621910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:03.639106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb1b29-3341-49e4-adb6-52edb4491b07 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:03.845423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:03.846112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:03.846395 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:03.846669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] PATH_INFO: `/v3/projects/4d8d85eea1344d03bf13c75a69015a12` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:03.854389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8d85eea1344d03bf13c75a69015a12)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:03.856356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:03.989631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8d85eea1344d03bf13c75a69015a12', 'request_id': 'req-dac80498-e17d-4059-ace0-7b6ad85f00c6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:04.001106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8d85eea1344d03bf13c75a69015a12', 'request_id': 'req-dac80498-e17d-4059-ace0-7b6ad85f00c6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:04.013594 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8d85eea1344d03bf13c75a69015a12', 'request_id': 'req-dac80498-e17d-4059-ace0-7b6ad85f00c6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:04.049352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] The token cache is being invalidate because project 4d8d85eea1344d03bf13c75a69015a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:04.050046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:04.054798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-dac80498-e17d-4059-ace0-7b6ad85f00c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:04.058573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1122/2251] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:03 2022] DELETE /identity/v3/projects/4d8d85eea1344d03bf13c75a69015a12 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:04.063536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8a98-5427-42f0-ab4c-7eee05d0121c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.064485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8a98-5427-42f0-ab4c-7eee05d0121c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.064933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c8a98-5427-42f0-ab4c-7eee05d0121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.154513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ae1c8a98-5427-42f0-ab4c-7eee05d0121c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:04.159030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ae1c8a98-5427-42f0-ab4c-7eee05d0121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:04.295980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1130/2252] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:04.304569 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38767f-efaa-4e65-88c0-9f83cc100f7c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.305223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38767f-efaa-4e65-88c0-9f83cc100f7c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.306369 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38767f-efaa-4e65-88c0-9f83cc100f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.361821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-7c38767f-efaa-4e65-88c0-9f83cc100f7c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:04.361821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7c38767f-efaa-4e65-88c0-9f83cc100f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:04.378049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1123/2253] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:04.381952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8a98-5427-42f0-ab4c-7eee05d0121c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:04.393392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c8a98-5427-42f0-ab4c-7eee05d0121c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:04.404191 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:04.404977 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.405364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.405769 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.406549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:04.407947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:04.410349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:04.433018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1131/2254] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:06:04.437454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38767f-efaa-4e65-88c0-9f83cc100f7c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:04.448701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38767f-efaa-4e65-88c0-9f83cc100f7c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:04.455467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b230f-81ef-45be-8f12-695c470d29c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:04.456336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b230f-81ef-45be-8f12-695c470d29c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.456824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b230f-81ef-45be-8f12-695c470d29c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.457168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b230f-81ef-45be-8f12-695c470d29c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.458459 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b230f-81ef-45be-8f12-695c470d29c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:04.461620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b230f-81ef-45be-8f12-695c470d29c5 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:04.500035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1124/2255] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:04 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:04.503990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:04.520854 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0f3b6-3c8c-48c1-92d7-06cdb265a041 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:04.531059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:04.613528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e85a0-94f5-48be-b33d-a82bea25cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:04.614328 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e85a0-94f5-48be-b33d-a82bea25cd26 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.614721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e85a0-94f5-48be-b33d-a82bea25cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.615153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e85a0-94f5-48be-b33d-a82bea25cd26 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.616111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e85a0-94f5-48be-b33d-a82bea25cd26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:04.618528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e85a0-94f5-48be-b33d-a82bea25cd26 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:04.650722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1132/2256] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:04 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:04.655178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b230f-81ef-45be-8f12-695c470d29c5 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:04.672936 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b230f-81ef-45be-8f12-695c470d29c5 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:04.687288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda29a4-9bca-4bcb-8ba0-2bf4a2f4280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:04.687897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda29a4-9bca-4bcb-8ba0-2bf4a2f4280e admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.688180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda29a4-9bca-4bcb-8ba0-2bf4a2f4280e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.688454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda29a4-9bca-4bcb-8ba0-2bf4a2f4280e admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.689135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda29a4-9bca-4bcb-8ba0-2bf4a2f4280e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:04.690825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda29a4-9bca-4bcb-8ba0-2bf4a2f4280e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:04.714436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1125/2257] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:04.718229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e85a0-94f5-48be-b33d-a82bea25cd26 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:04.743636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e85a0-94f5-48be-b33d-a82bea25cd26 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:04.750551 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b292f-638b-435b-a0ce-2c51f745ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:04.751291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b292f-638b-435b-a0ce-2c51f745ae32 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.751684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b292f-638b-435b-a0ce-2c51f745ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.752031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b292f-638b-435b-a0ce-2c51f745ae32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.753689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b292f-638b-435b-a0ce-2c51f745ae32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:04.756624 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b292f-638b-435b-a0ce-2c51f745ae32 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:04.794082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1133/2258] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:04.802105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda29a4-9bca-4bcb-8ba0-2bf4a2f4280e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:04.815345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda29a4-9bca-4bcb-8ba0-2bf4a2f4280e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:04.831181 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aa6bc-ff82-40d5-bf33-287cc708525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:04.831875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa6bc-ff82-40d5-bf33-287cc708525a admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.832157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa6bc-ff82-40d5-bf33-287cc708525a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.832433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa6bc-ff82-40d5-bf33-287cc708525a admin admin] PATH_INFO: `/v3/projects/227085d542aa428eafb9ad7999eac86e/users/2641dc2f0028465e9289614be904a5d2/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.868529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aa6bc-ff82-40d5-bf33-287cc708525a admin admin] RBAC: Authorizing `identity:create_grant(project_id=227085d542aa428eafb9ad7999eac86e, user_id=2641dc2f0028465e9289614be904a5d2, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:04.874531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aa6bc-ff82-40d5-bf33-287cc708525a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:04.899242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1126/2259] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:04 2022] PUT /identity/v3/projects/227085d542aa428eafb9ad7999eac86e/users/2641dc2f0028465e9289614be904a5d2/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:04.910763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d315ba4-9235-4f95-a93c-5c9c79e2cdd6 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:04.911135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d315ba4-9235-4f95-a93c-5c9c79e2cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:04.911325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d315ba4-9235-4f95-a93c-5c9c79e2cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:04.955907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-2d315ba4-9235-4f95-a93c-5c9c79e2cdd6 None None] MFA Rules not processed for user `2641dc2f0028465e9289614be904a5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:04.957332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2d315ba4-9235-4f95-a93c-5c9c79e2cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:05.037139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1134/2260] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:05.042018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aa6bc-ff82-40d5-bf33-287cc708525a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:05.066677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:05.213872 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aa6bc-ff82-40d5-bf33-287cc708525a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:05.226002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445cf3-2256-4709-9fa5-cc2c61c24517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:05.227164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445cf3-2256-4709-9fa5-cc2c61c24517 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.227653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445cf3-2256-4709-9fa5-cc2c61c24517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.228133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445cf3-2256-4709-9fa5-cc2c61c24517 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.228990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445cf3-2256-4709-9fa5-cc2c61c24517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:05.231183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445cf3-2256-4709-9fa5-cc2c61c24517 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:05.291783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1127/2261] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:05 2022] POST /identity/v3/projects => generated 381 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:05.293982 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d315ba4-9235-4f95-a93c-5c9c79e2cdd6 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:05.310702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d315ba4-9235-4f95-a93c-5c9c79e2cdd6 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:05.344239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570952-ad6e-40cc-a256-f4ff5698ec75 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.344546 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570952-ad6e-40cc-a256-f4ff5698ec75 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.344802 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570952-ad6e-40cc-a256-f4ff5698ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.419757 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8c570952-ad6e-40cc-a256-f4ff5698ec75 None None] MFA Rules not processed for user `77390850abe64c2782654fcd01434ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:05.421132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8c570952-ad6e-40cc-a256-f4ff5698ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:05.451158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18edf4-b60e-457d-a3c3-f9e1aa7b4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:05.452733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18edf4-b60e-457d-a3c3-f9e1aa7b4d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.452733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18edf4-b60e-457d-a3c3-f9e1aa7b4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.452733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18edf4-b60e-457d-a3c3-f9e1aa7b4d3e admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.453006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18edf4-b60e-457d-a3c3-f9e1aa7b4d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:05.455259 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18edf4-b60e-457d-a3c3-f9e1aa7b4d3e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:05.506638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1135/2262] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:05 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:05.508454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18edf4-b60e-457d-a3c3-f9e1aa7b4d3e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:05.519392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18edf4-b60e-457d-a3c3-f9e1aa7b4d3e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:05.527029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acfbfe-4d76-42bb-ab11-6f2f380fda44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:05.527794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acfbfe-4d76-42bb-ab11-6f2f380fda44 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.528194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acfbfe-4d76-42bb-ab11-6f2f380fda44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.528562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acfbfe-4d76-42bb-ab11-6f2f380fda44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.529314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acfbfe-4d76-42bb-ab11-6f2f380fda44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:05.531046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acfbfe-4d76-42bb-ab11-6f2f380fda44 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:05.534010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:05.551867 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1136/2263] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:05.555325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acfbfe-4d76-42bb-ab11-6f2f380fda44 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:05.575052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acfbfe-4d76-42bb-ab11-6f2f380fda44 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:05.579993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01da9c-5bef-4ff5-b53d-421ddd102f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:05.581176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01da9c-5bef-4ff5-b53d-421ddd102f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.581465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01da9c-5bef-4ff5-b53d-421ddd102f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.581779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01da9c-5bef-4ff5-b53d-421ddd102f21 admin admin] PATH_INFO: `/v3/projects/e56753ee180f4bf7a16f7e9c6664c5ff/users/62580650d26345a6be973523159746f3/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.602500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1128/2264] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:05.607749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01da9c-5bef-4ff5-b53d-421ddd102f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56753ee180f4bf7a16f7e9c6664c5ff, user_id=62580650d26345a6be973523159746f3, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:05.611151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01da9c-5bef-4ff5-b53d-421ddd102f21 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:05.617462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570952-ad6e-40cc-a256-f4ff5698ec75 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:05.619432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8c570952-ad6e-40cc-a256-f4ff5698ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:05.629085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1137/2265] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:05 2022] PUT /identity/v3/projects/e56753ee180f4bf7a16f7e9c6664c5ff/users/62580650d26345a6be973523159746f3/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:05.633458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01da9c-5bef-4ff5-b53d-421ddd102f21 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:05.723335 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c570952-ad6e-40cc-a256-f4ff5698ec75 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:05.787673 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01da9c-5bef-4ff5-b53d-421ddd102f21 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:05.800852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0370-4951-4cdd-aa0e-9d389cca61b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:05.801515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0370-4951-4cdd-aa0e-9d389cca61b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.801785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0370-4951-4cdd-aa0e-9d389cca61b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.802058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0370-4951-4cdd-aa0e-9d389cca61b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.802717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0370-4951-4cdd-aa0e-9d389cca61b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:05.805601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0370-4951-4cdd-aa0e-9d389cca61b3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:05.820643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:05.839074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1138/2266] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:05.840023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0370-4951-4cdd-aa0e-9d389cca61b3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:05.858788 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3697284166c042d79d946ef469932562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:05.859429 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.859696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.860235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.868046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:05.885461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0370-4951-4cdd-aa0e-9d389cca61b3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:05.892616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d88a-0f8c-4413-869d-2350affec090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:05.893844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d88a-0f8c-4413-869d-2350affec090 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.894452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d88a-0f8c-4413-869d-2350affec090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.894909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d88a-0f8c-4413-869d-2350affec090 admin admin] PATH_INFO: `/v3/projects/e56753ee180f4bf7a16f7e9c6664c5ff/users/62580650d26345a6be973523159746f3/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.900037 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d88a-0f8c-4413-869d-2350affec090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56753ee180f4bf7a16f7e9c6664c5ff, user_id=62580650d26345a6be973523159746f3, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:05.906321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d88a-0f8c-4413-869d-2350affec090 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:05.932405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1139/2267] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:05 2022] PUT /identity/v3/projects/e56753ee180f4bf7a16f7e9c6664c5ff/users/62580650d26345a6be973523159746f3/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:05.944019 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84a8e-1a12-477a-a1e6-bf6a46800e94 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:05.944540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84a8e-1a12-477a-a1e6-bf6a46800e94 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:05.944882 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84a8e-1a12-477a-a1e6-bf6a46800e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:05.964865 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:05.966628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:05.989363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1129/2268] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:06.001311 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-75c84a8e-1a12-477a-a1e6-bf6a46800e94 None None] MFA Rules not processed for user `62580650d26345a6be973523159746f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:06.002900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-75c84a8e-1a12-477a-a1e6-bf6a46800e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:06.108719 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1140/2269] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:06.124112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:06.126500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:06.216862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed4bb2-2e9b-4709-a282-371d14eee3f3 service glance] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:06.238995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830229e1-ec0a-4cf9-a716-07939b1ccb6f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:06.239410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830229e1-ec0a-4cf9-a716-07939b1ccb6f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:06.239699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830229e1-ec0a-4cf9-a716-07939b1ccb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:06.275682 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-830229e1-ec0a-4cf9-a716-07939b1ccb6f None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:06.277078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-830229e1-ec0a-4cf9-a716-07939b1ccb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:06.340656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:06.341397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:06.344120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:06.344400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:06.365197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:06.366723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:06.385010 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1130/2270] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:06.391987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:06.428838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1141/2271] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:06:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:06.445797 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:06.447368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:06.532883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:06.543001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830229e1-ec0a-4cf9-a716-07939b1ccb6f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:06.556009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830229e1-ec0a-4cf9-a716-07939b1ccb6f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:06.560801 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:06.561643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:06.561989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:06.562337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:06.578694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0cf4b-0db8-429c-bb99-5961c17e8f16 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:06.584837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:06.586067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:06.586284 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:06.586559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:06.624307 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:06.626709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:06.643606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1131/2272] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:06:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:06.728388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:06.728388 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:06.763141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1142/2273] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:06:07.132195 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:07.134444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:07.260161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:07.261670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:07.295356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dd4a3-5dfa-422d-8b25-29f075273497 service swift] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:07.307637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:07.308615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:07.308714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:07.310246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:07.315997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:07.348343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:07.350388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:07.366036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1132/2274] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:07.368095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:07.464245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d4a59-cdcb-4165-bdca-6f863fd6988e service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:07.478704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:07.479368 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:07.479642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:07.479912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] PATH_INFO: `/v3/users/0bcbf6513b6a4df3b044fadfb7888d54` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:07.481414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bcbf6513b6a4df3b044fadfb7888d54)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:07.483656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:07.497697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f54e-4785-452f-a486-39f948fb7d24 service placement] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:07.502998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:07.503861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:07.504387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:07.504769 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] PATH_INFO: `/v3/users/2641dc2f0028465e9289614be904a5d2` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:07.506086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2641dc2f0028465e9289614be904a5d2)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:07.509870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:07.585727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bcbf6513b6a4df3b044fadfb7888d54'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.608535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bcbf6513b6a4df3b044fadfb7888d54'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.609303 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bcbf6513b6a4df3b044fadfb7888d54'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.619668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bcbf6513b6a4df3b044fadfb7888d54'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.620402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-42211daa-56ac-4634-9aaa-f08e295e289d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bcbf6513b6a4df3b044fadfb7888d54'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.625829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2641dc2f0028465e9289614be904a5d2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.645286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1143/2275] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:07 2022] DELETE /identity/v3/users/0bcbf6513b6a4df3b044fadfb7888d54 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:07.648687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2641dc2f0028465e9289614be904a5d2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.649443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2641dc2f0028465e9289614be904a5d2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.664251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:07.674239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2641dc2f0028465e9289614be904a5d2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.675753 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2641dc2f0028465e9289614be904a5d2'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:07.697966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1133/2276] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:07 2022] DELETE /identity/v3/users/2641dc2f0028465e9289614be904a5d2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:07.703211 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642c9e-1914-4496-8408-262abff1cf7a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:07.703752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642c9e-1914-4496-8408-262abff1cf7a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:07.704215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642c9e-1914-4496-8408-262abff1cf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:07.717587 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:07.734488 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-48642c9e-1914-4496-8408-262abff1cf7a None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:07.737894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-48642c9e-1914-4496-8408-262abff1cf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:07.908739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1144/2277] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:07.915535 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:07.917260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:07.926275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642c9e-1914-4496-8408-262abff1cf7a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:07.928642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-48642c9e-1914-4496-8408-262abff1cf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:07.972235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642c9e-1914-4496-8408-262abff1cf7a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:07.994572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:07.995490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.005114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.005721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] PATH_INFO: `/v3/projects/6c0d083e8cef4333b9514d2256991647` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.008253 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c0d083e8cef4333b9514d2256991647)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.010497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.086032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73894460-5afa-4cdb-a1b3-7624f09d99de admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.090271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5a6bf-23ea-4be5-b0e1-43933d3a02f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:08.091033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5a6bf-23ea-4be5-b0e1-43933d3a02f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.091202 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5a6bf-23ea-4be5-b0e1-43933d3a02f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.091481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5a6bf-23ea-4be5-b0e1-43933d3a02f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.105374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5a6bf-23ea-4be5-b0e1-43933d3a02f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.107321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5a6bf-23ea-4be5-b0e1-43933d3a02f5 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.121738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c0d083e8cef4333b9514d2256991647', 'request_id': 'req-c7b77235-413f-49e5-acd7-23e1360d2f59'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:08.134522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1134/2278] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:06:08.134991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c0d083e8cef4333b9514d2256991647', 'request_id': 'req-c7b77235-413f-49e5-acd7-23e1360d2f59'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:08.149561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c0d083e8cef4333b9514d2256991647', 'request_id': 'req-c7b77235-413f-49e5-acd7-23e1360d2f59'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:08.181922 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] The token cache is being invalidate because project 6c0d083e8cef4333b9514d2256991647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:08.182415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:08.183228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c7b77235-413f-49e5-acd7-23e1360d2f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:08.185644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1145/2279] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:07 2022] DELETE /identity/v3/projects/6c0d083e8cef4333b9514d2256991647 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:08.197390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6507f31-f6a5-4b02-90ed-f8a29a0bf99d None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.197710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6507f31-f6a5-4b02-90ed-f8a29a0bf99d None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.197988 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6507f31-f6a5-4b02-90ed-f8a29a0bf99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.233294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b6507f31-f6a5-4b02-90ed-f8a29a0bf99d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:08.236458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b6507f31-f6a5-4b02-90ed-f8a29a0bf99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:08.386021 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1135/2280] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:08.393844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9d9e2-7151-4dc0-b178-493a78627071 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.394131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9d9e2-7151-4dc0-b178-493a78627071 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.394406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9d9e2-7151-4dc0-b178-493a78627071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.424554 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-26a9d9e2-7151-4dc0-b178-493a78627071 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:08.425846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-26a9d9e2-7151-4dc0-b178-493a78627071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:08.446803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6507f31-f6a5-4b02-90ed-f8a29a0bf99d None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:08.460746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6507f31-f6a5-4b02-90ed-f8a29a0bf99d None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.461411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1146/2281] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:08.467077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:08.467918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.468201 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.468474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.469145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:08.469450 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.471878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.493416 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1136/2282] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:06:08.494325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9d9e2-7151-4dc0-b178-493a78627071 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:08.514038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9d9e2-7151-4dc0-b178-493a78627071 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.522168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:08.523004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.523684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.524005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.528337 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.532194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.585722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:08.593046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1147/2283] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:08 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:08.602102 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd446-427e-4efb-b0a5-8f2d22bf7b44 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.719571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:08.722569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:08.746957 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba19a4-c6c5-4a70-b9e7-36c93a8e3434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:08.747859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba19a4-c6c5-4a70-b9e7-36c93a8e3434 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.748611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba19a4-c6c5-4a70-b9e7-36c93a8e3434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.748611 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba19a4-c6c5-4a70-b9e7-36c93a8e3434 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.749207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba19a4-c6c5-4a70-b9e7-36c93a8e3434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.751719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba19a4-c6c5-4a70-b9e7-36c93a8e3434 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.784756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1137/2284] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:08 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:08.786169 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba19a4-c6c5-4a70-b9e7-36c93a8e3434 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:08.799818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba19a4-c6c5-4a70-b9e7-36c93a8e3434 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.808289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cb94-396a-43c5-8a4d-74f6a7a9bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:08.809346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cb94-396a-43c5-8a4d-74f6a7a9bf2b admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.809874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cb94-396a-43c5-8a4d-74f6a7a9bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.810384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9cb94-396a-43c5-8a4d-74f6a7a9bf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.811528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9cb94-396a-43c5-8a4d-74f6a7a9bf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.813545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9cb94-396a-43c5-8a4d-74f6a7a9bf2b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.815863 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:08.832342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5994c-031e-4024-8fc6-f30fc2e94328 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.840221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1138/2285] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:08.841454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cb94-396a-43c5-8a4d-74f6a7a9bf2b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:08.842826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:08.844386 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.844918 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.845975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] PATH_INFO: `/v3/projects/227085d542aa428eafb9ad7999eac86e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.848072 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227085d542aa428eafb9ad7999eac86e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.854615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.856399 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9cb94-396a-43c5-8a4d-74f6a7a9bf2b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.856968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:08.865882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64387ea-ea1f-4c33-aaf9-0857c3801819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:08.868025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64387ea-ea1f-4c33-aaf9-0857c3801819 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.868305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64387ea-ea1f-4c33-aaf9-0857c3801819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.868582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64387ea-ea1f-4c33-aaf9-0857c3801819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.870147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64387ea-ea1f-4c33-aaf9-0857c3801819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.872422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64387ea-ea1f-4c33-aaf9-0857c3801819 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.901782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1139/2286] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:08.903240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64387ea-ea1f-4c33-aaf9-0857c3801819 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:08.928104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64387ea-ea1f-4c33-aaf9-0857c3801819 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.952166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227085d542aa428eafb9ad7999eac86e', 'request_id': 'req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:08.960530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227085d542aa428eafb9ad7999eac86e', 'request_id': 'req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:08.969301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227085d542aa428eafb9ad7999eac86e', 'request_id': 'req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:09.001452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] The token cache is being invalidate because project 227085d542aa428eafb9ad7999eac86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:09.003054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:09.007139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:09.010697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1148/2287] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:08 2022] DELETE /identity/v3/projects/227085d542aa428eafb9ad7999eac86e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:06:09.014298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:09.015790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:09.049830 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d4618-f0e0-4307-95ee-02b2847f1577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:09.050409 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d4618-f0e0-4307-95ee-02b2847f1577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:09.050682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d4618-f0e0-4307-95ee-02b2847f1577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:09.050952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d4618-f0e0-4307-95ee-02b2847f1577 admin admin] PATH_INFO: `/v3/projects/bf95eb72df7c44c6be34a99178afa63e/users/80052133df7f4d34a70d5626bf767727/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:09.075339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d4618-f0e0-4307-95ee-02b2847f1577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf95eb72df7c44c6be34a99178afa63e, user_id=80052133df7f4d34a70d5626bf767727, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:09.078058 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d4618-f0e0-4307-95ee-02b2847f1577 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:09.097532 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1140/2288] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:08 2022] PUT /identity/v3/projects/bf95eb72df7c44c6be34a99178afa63e/users/80052133df7f4d34a70d5626bf767727/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:09.108916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e504-47f4-4954-b495-772c06fd5171 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:09.109337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e504-47f4-4954-b495-772c06fd5171 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:09.109657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772e504-47f4-4954-b495-772c06fd5171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:09.146239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9772e504-47f4-4954-b495-772c06fd5171 None None] MFA Rules not processed for user `80052133df7f4d34a70d5626bf767727`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:09.147983 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9772e504-47f4-4954-b495-772c06fd5171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:09.149387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c62d9-3b25-4531-8c0a-a0466ba761d7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:09.248418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:09.249071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:09.249345 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:09.251183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] PATH_INFO: `/v3/users/62580650d26345a6be973523159746f3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:09.253161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62580650d26345a6be973523159746f3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:09.255149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:09.287101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1141/2289] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:09.294559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772e504-47f4-4954-b495-772c06fd5171 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:09.296045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9772e504-47f4-4954-b495-772c06fd5171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:09.354910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:09.366875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62580650d26345a6be973523159746f3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:09.388844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62580650d26345a6be973523159746f3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:09.390348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62580650d26345a6be973523159746f3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:09.391492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:09.403395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62580650d26345a6be973523159746f3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:09.405431 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62580650d26345a6be973523159746f3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:09.421039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772e504-47f4-4954-b495-772c06fd5171 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:09.425855 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1149/2290] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:09 2022] DELETE /identity/v3/users/62580650d26345a6be973523159746f3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:09.502106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b703c92-57d5-4f1c-a611-054c3fef86e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:09.504442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703c92-57d5-4f1c-a611-054c3fef86e2 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:09.504939 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703c92-57d5-4f1c-a611-054c3fef86e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:09.505456 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703c92-57d5-4f1c-a611-054c3fef86e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:09.509392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1b703c92-57d5-4f1c-a611-054c3fef86e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:09.629316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b703c92-57d5-4f1c-a611-054c3fef86e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:09.631011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b703c92-57d5-4f1c-a611-054c3fef86e2 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:09.650666 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1142/2291] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:09.943632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:09.950678 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:10.073573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937a361-e09c-4c97-90c3-ce3b59eb1878 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:10.079554 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:10.080201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.080487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.080971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] PATH_INFO: `/v3/projects/e56753ee180f4bf7a16f7e9c6664c5ff` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.082397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56753ee180f4bf7a16f7e9c6664c5ff)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:10.084451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:10.177757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56753ee180f4bf7a16f7e9c6664c5ff', 'request_id': 'req-b71f0e61-65c2-4204-9857-311a30a9cc35'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:10.188004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56753ee180f4bf7a16f7e9c6664c5ff', 'request_id': 'req-b71f0e61-65c2-4204-9857-311a30a9cc35'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:10.196902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56753ee180f4bf7a16f7e9c6664c5ff', 'request_id': 'req-b71f0e61-65c2-4204-9857-311a30a9cc35'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:10.226513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] The token cache is being invalidate because project e56753ee180f4bf7a16f7e9c6664c5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:10.228740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:10.229507 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b71f0e61-65c2-4204-9857-311a30a9cc35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:10.235866 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1150/2292] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:09 2022] DELETE /identity/v3/projects/e56753ee180f4bf7a16f7e9c6664c5ff => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:10.237840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3afb-ac9b-4bb1-a7a9-71511cc7e8da None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.238289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3afb-ac9b-4bb1-a7a9-71511cc7e8da None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.238392 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3afb-ac9b-4bb1-a7a9-71511cc7e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.322745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-cf0f3afb-ac9b-4bb1-a7a9-71511cc7e8da None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:10.330602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cf0f3afb-ac9b-4bb1-a7a9-71511cc7e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:10.468338 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1143/2293] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:10.471760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d955d6c-0a4c-407a-808b-375fc0a4d6a6 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.472049 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d955d6c-0a4c-407a-808b-375fc0a4d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.472321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d955d6c-0a4c-407a-808b-375fc0a4d6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.513176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-5d955d6c-0a4c-407a-808b-375fc0a4d6a6 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:10.514591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-5d955d6c-0a4c-407a-808b-375fc0a4d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:10.527524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1151/2294] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:10.531393 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3afb-ac9b-4bb1-a7a9-71511cc7e8da None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:10.545103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3afb-ac9b-4bb1-a7a9-71511cc7e8da None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:10.554619 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:10.555547 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.555832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.556609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.556798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:10.557054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:10.558694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:10.578230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1144/2295] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:06:10.582349 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d955d6c-0a4c-407a-808b-375fc0a4d6a6 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:10.610437 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d955d6c-0a4c-407a-808b-375fc0a4d6a6 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:10.623853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda4c6-ea9b-4ffc-b594-af917b55bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:10.624956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda4c6-ea9b-4ffc-b594-af917b55bcfc admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.625237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda4c6-ea9b-4ffc-b594-af917b55bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.625555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda4c6-ea9b-4ffc-b594-af917b55bcfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.626197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbda4c6-ea9b-4ffc-b594-af917b55bcfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:10.628474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbda4c6-ea9b-4ffc-b594-af917b55bcfc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:10.675859 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1152/2296] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:10 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:10.680500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:10.697375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e617aa-cad8-4423-8a0b-93a338ec2d87 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:10.726439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=100 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:10.788111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14271289-25d9-45f6-bc77-ab07c11bddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:10.788850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14271289-25d9-45f6-bc77-ab07c11bddcd admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.789130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14271289-25d9-45f6-bc77-ab07c11bddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.789410 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14271289-25d9-45f6-bc77-ab07c11bddcd admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.790101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14271289-25d9-45f6-bc77-ab07c11bddcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:10.792162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14271289-25d9-45f6-bc77-ab07c11bddcd admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:10.824008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1145/2297] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:10 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:10.825577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda4c6-ea9b-4ffc-b594-af917b55bcfc admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:10.837229 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda4c6-ea9b-4ffc-b594-af917b55bcfc admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:10.844508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0613e33-d03c-4d57-a11e-b07941a46161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:10.845137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613e33-d03c-4d57-a11e-b07941a46161 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.845411 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613e33-d03c-4d57-a11e-b07941a46161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.845791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613e33-d03c-4d57-a11e-b07941a46161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.846504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0613e33-d03c-4d57-a11e-b07941a46161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:10.848140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0613e33-d03c-4d57-a11e-b07941a46161 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:10.860342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1153/2298] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:10.867014 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14271289-25d9-45f6-bc77-ab07c11bddcd admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:10.889064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14271289-25d9-45f6-bc77-ab07c11bddcd admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:10.895748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132b100-ff60-4f25-b32e-8a80b34d2023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:10.896373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132b100-ff60-4f25-b32e-8a80b34d2023 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.896653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132b100-ff60-4f25-b32e-8a80b34d2023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.896933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132b100-ff60-4f25-b32e-8a80b34d2023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.897720 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132b100-ff60-4f25-b32e-8a80b34d2023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:10.901828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132b100-ff60-4f25-b32e-8a80b34d2023 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:10.915188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1146/2299] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:10.921336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0613e33-d03c-4d57-a11e-b07941a46161 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:10.934196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0613e33-d03c-4d57-a11e-b07941a46161 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:10.941900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca1313-cd60-458a-bfe6-d5231e499c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:10.943112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1313-cd60-458a-bfe6-d5231e499c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:10.943548 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1313-cd60-458a-bfe6-d5231e499c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:10.943923 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1313-cd60-458a-bfe6-d5231e499c9e admin admin] PATH_INFO: `/v3/projects/9c6679084def49788e9f250f8f950cd7/users/a60c8840d5b540448a139cea8b78b906/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:10.946564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:10.973853 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca1313-cd60-458a-bfe6-d5231e499c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6679084def49788e9f250f8f950cd7, user_id=a60c8840d5b540448a139cea8b78b906, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:10.978406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca1313-cd60-458a-bfe6-d5231e499c9e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:11.007316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1154/2300] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:10 2022] PUT /identity/v3/projects/9c6679084def49788e9f250f8f950cd7/users/a60c8840d5b540448a139cea8b78b906/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:11.009111 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcfad2-c5ff-4151-a985-ac8afffee6ce None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.010176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcfad2-c5ff-4151-a985-ac8afffee6ce None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.010176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcfad2-c5ff-4151-a985-ac8afffee6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:11.048754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-adfcfad2-c5ff-4151-a985-ac8afffee6ce None None] MFA Rules not processed for user `a60c8840d5b540448a139cea8b78b906`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:11.050075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-adfcfad2-c5ff-4151-a985-ac8afffee6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:11.152643 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1147/2301] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:11.153194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca1313-cd60-458a-bfe6-d5231e499c9e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:11.259824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca1313-cd60-458a-bfe6-d5231e499c9e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:11.266421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c638-c688-42a6-bb78-53ed691ad92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:11.267117 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c638-c688-42a6-bb78-53ed691ad92b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.267322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c638-c688-42a6-bb78-53ed691ad92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.267732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c638-c688-42a6-bb78-53ed691ad92b admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:11.268457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c638-c688-42a6-bb78-53ed691ad92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:11.270419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c638-c688-42a6-bb78-53ed691ad92b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:11.305616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1155/2302] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:11 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:06:11.309596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcfad2-c5ff-4151-a985-ac8afffee6ce None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:11.323892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcfad2-c5ff-4151-a985-ac8afffee6ce None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:11.400013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b662326-a71e-4c8c-928c-de89f73d615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:11.400648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b662326-a71e-4c8c-928c-de89f73d615a admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.401030 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b662326-a71e-4c8c-928c-de89f73d615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.401310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b662326-a71e-4c8c-928c-de89f73d615a admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:11.402061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b662326-a71e-4c8c-928c-de89f73d615a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:11.404168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b662326-a71e-4c8c-928c-de89f73d615a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:11.433179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1148/2303] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:11 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:11.437461 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c638-c688-42a6-bb78-53ed691ad92b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:11.451001 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c638-c688-42a6-bb78-53ed691ad92b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:11.455729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c07a-9618-4598-8276-c10a09176e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:11.456327 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c07a-9618-4598-8276-c10a09176e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.456990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c07a-9618-4598-8276-c10a09176e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.457089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c07a-9618-4598-8276-c10a09176e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:11.458668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c07a-9618-4598-8276-c10a09176e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:11.460600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c07a-9618-4598-8276-c10a09176e05 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:11.480392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1156/2304] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:11.484485 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b662326-a71e-4c8c-928c-de89f73d615a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:11.498033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b662326-a71e-4c8c-928c-de89f73d615a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:11.504620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6810ef4-fb98-4bd2-9c53-a74e894ffbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:11.505398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6810ef4-fb98-4bd2-9c53-a74e894ffbfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.505717 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6810ef4-fb98-4bd2-9c53-a74e894ffbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.505990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6810ef4-fb98-4bd2-9c53-a74e894ffbfa admin admin] PATH_INFO: `/v3/projects/7afeca3d32844a6c8ba0abc4fb13dd6e/users/a67c1371031d4063b09a0729bbc42dba/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:11.526052 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6810ef4-fb98-4bd2-9c53-a74e894ffbfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afeca3d32844a6c8ba0abc4fb13dd6e, user_id=a67c1371031d4063b09a0729bbc42dba, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:11.528723 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6810ef4-fb98-4bd2-9c53-a74e894ffbfa admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:11.531105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:11.552840 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1149/2305] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:11 2022] PUT /identity/v3/projects/7afeca3d32844a6c8ba0abc4fb13dd6e/users/a67c1371031d4063b09a0729bbc42dba/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:11.559453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c07a-9618-4598-8276-c10a09176e05 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:11.574100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c07a-9618-4598-8276-c10a09176e05 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:11.676140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c8a41-6c79-4c13-85ed-160f5abdd75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:11.676752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8a41-6c79-4c13-85ed-160f5abdd75d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.677032 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8a41-6c79-4c13-85ed-160f5abdd75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.677352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8a41-6c79-4c13-85ed-160f5abdd75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:11.678040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c8a41-6c79-4c13-85ed-160f5abdd75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:11.680424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c8a41-6c79-4c13-85ed-160f5abdd75d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:11.693541 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1157/2306] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:11.697251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6810ef4-fb98-4bd2-9c53-a74e894ffbfa admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:11.715588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6810ef4-fb98-4bd2-9c53-a74e894ffbfa admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:11.722280 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:11.723235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.723629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.723976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] PATH_INFO: `/v3/projects/7afeca3d32844a6c8ba0abc4fb13dd6e/users/a67c1371031d4063b09a0729bbc42dba/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:11.728876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afeca3d32844a6c8ba0abc4fb13dd6e, user_id=a67c1371031d4063b09a0729bbc42dba, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:11.731810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:11.756131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1150/2307] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:11 2022] PUT /identity/v3/projects/7afeca3d32844a6c8ba0abc4fb13dd6e/users/a67c1371031d4063b09a0729bbc42dba/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:06:11.760114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d59c1-f275-4a60-9a42-6c9924e9177d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.761116 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d59c1-f275-4a60-9a42-6c9924e9177d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.761516 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d59c1-f275-4a60-9a42-6c9924e9177d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:11.801592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-110d59c1-f275-4a60-9a42-6c9924e9177d None None] MFA Rules not processed for user `a67c1371031d4063b09a0729bbc42dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:11.803048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-110d59c1-f275-4a60-9a42-6c9924e9177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:11.857846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:11.894563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1158/2308] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:11.907585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:11.909654 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:11.993764 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf33bd-08a5-484f-a0b0-ead7fba1e644 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:11.997572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51d612-be20-4d5e-a44b-c6727b323fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:11.998179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d612-be20-4d5e-a44b-c6727b323fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:11.998478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d612-be20-4d5e-a44b-c6727b323fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:11.998729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51d612-be20-4d5e-a44b-c6727b323fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:12.070134 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51d612-be20-4d5e-a44b-c6727b323fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:12.071903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51d612-be20-4d5e-a44b-c6727b323fe2 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:12.082961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1151/2309] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:12.895697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d59c1-f275-4a60-9a42-6c9924e9177d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:12.895697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-110d59c1-f275-4a60-9a42-6c9924e9177d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:12.966412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d59c1-f275-4a60-9a42-6c9924e9177d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:12.971928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:12.972574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:12.972851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:12.973123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] PATH_INFO: `/v3/users/80052133df7f4d34a70d5626bf767727` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:12.974885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80052133df7f4d34a70d5626bf767727)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:12.976874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:13.036550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80052133df7f4d34a70d5626bf767727'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.053152 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80052133df7f4d34a70d5626bf767727'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.056573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80052133df7f4d34a70d5626bf767727'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.066348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80052133df7f4d34a70d5626bf767727'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.067074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80052133df7f4d34a70d5626bf767727'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.081166 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1159/2310] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:12 2022] DELETE /identity/v3/users/80052133df7f4d34a70d5626bf767727 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:13.086310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d30d5-51cb-4adc-84c3-b122f6dd34ee None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:13.087609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d30d5-51cb-4adc-84c3-b122f6dd34ee None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:13.087899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d30d5-51cb-4adc-84c3-b122f6dd34ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:13.111070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-911d30d5-51cb-4adc-84c3-b122f6dd34ee None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:13.112517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-911d30d5-51cb-4adc-84c3-b122f6dd34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:13.185385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1152/2311] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:13.195775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:13.197266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:13.266392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e72a75-c0dc-4d15-afdf-afb331de8f35 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:13.276106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680475b5-98cf-4332-a85c-572c3ac1f2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:13.276885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680475b5-98cf-4332-a85c-572c3ac1f2ac service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:13.276885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680475b5-98cf-4332-a85c-572c3ac1f2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:13.276885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680475b5-98cf-4332-a85c-572c3ac1f2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:13.287496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680475b5-98cf-4332-a85c-572c3ac1f2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:13.289578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680475b5-98cf-4332-a85c-572c3ac1f2ac service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:13.296474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:13.302714 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1160/2312] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:13.651722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d30d5-51cb-4adc-84c3-b122f6dd34ee None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:13.653382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-911d30d5-51cb-4adc-84c3-b122f6dd34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:13.680415 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d30d5-51cb-4adc-84c3-b122f6dd34ee None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:13.703054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:13.703718 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:13.704002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:13.704278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] PATH_INFO: `/v3/projects/bf95eb72df7c44c6be34a99178afa63e` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:13.706163 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf95eb72df7c44c6be34a99178afa63e)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:13.708233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:13.785901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:13.805842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf95eb72df7c44c6be34a99178afa63e', 'request_id': 'req-16e8b711-c1db-4f1e-aa06-76e56c87973e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.811659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf95eb72df7c44c6be34a99178afa63e', 'request_id': 'req-16e8b711-c1db-4f1e-aa06-76e56c87973e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.820374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf95eb72df7c44c6be34a99178afa63e', 'request_id': 'req-16e8b711-c1db-4f1e-aa06-76e56c87973e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.836727 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] The token cache is being invalidate because project bf95eb72df7c44c6be34a99178afa63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:13.837312 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.838288 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-16e8b711-c1db-4f1e-aa06-76e56c87973e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:13.840179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1153/2313] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:13 2022] DELETE /identity/v3/projects/bf95eb72df7c44c6be34a99178afa63e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:13.845282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece2334-ce3f-4706-994f-e6dee7b70cd5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:13.845620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece2334-ce3f-4706-994f-e6dee7b70cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:13.845874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece2334-ce3f-4706-994f-e6dee7b70cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:13.871426 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9ece2334-ce3f-4706-994f-e6dee7b70cd5 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:13.872646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9ece2334-ce3f-4706-994f-e6dee7b70cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:13.953808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1161/2314] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:13.960269 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81777781-704c-4d2a-b7cd-6cf67b174b83 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:13.960563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81777781-704c-4d2a-b7cd-6cf67b174b83 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:13.960838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81777781-704c-4d2a-b7cd-6cf67b174b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:13.983869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-81777781-704c-4d2a-b7cd-6cf67b174b83 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:13.984782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-81777781-704c-4d2a-b7cd-6cf67b174b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:13.994166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1154/2315] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:13.998012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece2334-ce3f-4706-994f-e6dee7b70cd5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.011462 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece2334-ce3f-4706-994f-e6dee7b70cd5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.018658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.018981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.019295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.019572 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.020268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:14.020706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.023051 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.037023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1162/2316] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:06:14.041263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81777781-704c-4d2a-b7cd-6cf67b174b83 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.053589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81777781-704c-4d2a-b7cd-6cf67b174b83 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.058070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350c2c5-c676-4c06-a474-cd0430171788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.058780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c2c5-c676-4c06-a474-cd0430171788 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.059127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c2c5-c676-4c06-a474-cd0430171788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.059489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c2c5-c676-4c06-a474-cd0430171788 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.060192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350c2c5-c676-4c06-a474-cd0430171788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.062260 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350c2c5-c676-4c06-a474-cd0430171788 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.102558 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1155/2317] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:14 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:14.103482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.118111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928b82a-1c0b-4349-8504-da2cb9b31460 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.187021 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b571-c1ae-4287-824a-bff6a82955fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.187638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b571-c1ae-4287-824a-bff6a82955fa admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.187910 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b571-c1ae-4287-824a-bff6a82955fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.188179 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480b571-c1ae-4287-824a-bff6a82955fa admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.188811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480b571-c1ae-4287-824a-bff6a82955fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.190945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480b571-c1ae-4287-824a-bff6a82955fa admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.215860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1163/2318] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:14 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:06:14.219933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350c2c5-c676-4c06-a474-cd0430171788 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.232143 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350c2c5-c676-4c06-a474-cd0430171788 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.237453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c05d40-6111-47e4-8d10-7c7329d29835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.238125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05d40-6111-47e4-8d10-7c7329d29835 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.238400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05d40-6111-47e4-8d10-7c7329d29835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.238671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05d40-6111-47e4-8d10-7c7329d29835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.239336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c05d40-6111-47e4-8d10-7c7329d29835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.241567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c05d40-6111-47e4-8d10-7c7329d29835 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.252968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1156/2319] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:14.257717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b571-c1ae-4287-824a-bff6a82955fa admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.268891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480b571-c1ae-4287-824a-bff6a82955fa admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.274698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba9214-f956-45f7-9d3a-4ab58abec215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.274698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba9214-f956-45f7-9d3a-4ab58abec215 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.275133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba9214-f956-45f7-9d3a-4ab58abec215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.275278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba9214-f956-45f7-9d3a-4ab58abec215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.275958 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba9214-f956-45f7-9d3a-4ab58abec215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.277730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba9214-f956-45f7-9d3a-4ab58abec215 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.293559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1164/2320] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:14.296524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c05d40-6111-47e4-8d10-7c7329d29835 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.307862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c05d40-6111-47e4-8d10-7c7329d29835 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.312888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d1487-9d1a-4a9c-b817-b8a9e1d8170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.313705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d1487-9d1a-4a9c-b817-b8a9e1d8170e admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.314049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d1487-9d1a-4a9c-b817-b8a9e1d8170e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.314438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d1487-9d1a-4a9c-b817-b8a9e1d8170e admin admin] PATH_INFO: `/v3/projects/691da4d25a55474aa7575f3d2ce2fefc/users/32abb029b9134a0aae2ec3fd9251ecd0/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.341045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d1487-9d1a-4a9c-b817-b8a9e1d8170e admin admin] RBAC: Authorizing `identity:create_grant(project_id=691da4d25a55474aa7575f3d2ce2fefc, user_id=32abb029b9134a0aae2ec3fd9251ecd0, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.341045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d1487-9d1a-4a9c-b817-b8a9e1d8170e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.370065 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1157/2321] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:14 2022] PUT /identity/v3/projects/691da4d25a55474aa7575f3d2ce2fefc/users/32abb029b9134a0aae2ec3fd9251ecd0/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:06:14.384231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b844-01fe-4679-bea6-ed3bf11bfb62 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.384508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b844-01fe-4679-bea6-ed3bf11bfb62 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.384778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7b844-01fe-4679-bea6-ed3bf11bfb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.416184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-bca7b844-01fe-4679-bea6-ed3bf11bfb62 None None] MFA Rules not processed for user `32abb029b9134a0aae2ec3fd9251ecd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:14.417453 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bca7b844-01fe-4679-bea6-ed3bf11bfb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:14.507272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:14.519039 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1165/2322] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:14.523826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d1487-9d1a-4a9c-b817-b8a9e1d8170e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.599622 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d1487-9d1a-4a9c-b817-b8a9e1d8170e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.608765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2eac-d3a5-4f39-9365-3659986b615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.609468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2eac-d3a5-4f39-9365-3659986b615d admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.610132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2eac-d3a5-4f39-9365-3659986b615d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.610478 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2eac-d3a5-4f39-9365-3659986b615d admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.611188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2eac-d3a5-4f39-9365-3659986b615d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.613283 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2eac-d3a5-4f39-9365-3659986b615d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.648462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1158/2323] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:14 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:14.650075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b844-01fe-4679-bea6-ed3bf11bfb62 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.661790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7b844-01fe-4679-bea6-ed3bf11bfb62 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.732500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc3a8-871c-473b-9ad6-bce098161afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.733399 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc3a8-871c-473b-9ad6-bce098161afb admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.733720 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc3a8-871c-473b-9ad6-bce098161afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.734091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc3a8-871c-473b-9ad6-bce098161afb admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.735069 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebc3a8-871c-473b-9ad6-bce098161afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.737097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebc3a8-871c-473b-9ad6-bce098161afb admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.770353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1166/2324] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:14 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:14.770561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2eac-d3a5-4f39-9365-3659986b615d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.782743 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2eac-d3a5-4f39-9365-3659986b615d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.790703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.791374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.791624 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.791952 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.792612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.794255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.813903 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1159/2325] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:14.815233 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc3a8-871c-473b-9ad6-bce098161afb admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.816429 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.821420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:14.826913 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc3a8-871c-473b-9ad6-bce098161afb admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.831884 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58527ff-b8b7-4ab9-ac22-a955904ac6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.832704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58527ff-b8b7-4ab9-ac22-a955904ac6db admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.833084 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58527ff-b8b7-4ab9-ac22-a955904ac6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.833532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58527ff-b8b7-4ab9-ac22-a955904ac6db admin admin] PATH_INFO: `/v3/projects/a28672bd478c4599aed44d7506edf982/users/c3108d9b61d246538790a8b75ae5fee0/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.850846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58527ff-b8b7-4ab9-ac22-a955904ac6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28672bd478c4599aed44d7506edf982, user_id=c3108d9b61d246538790a8b75ae5fee0, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.851225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd34fd8-cd25-4538-9603-443eee03bb8f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.853893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58527ff-b8b7-4ab9-ac22-a955904ac6db admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.856079 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:14.856908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.857275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.857664 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] PATH_INFO: `/v3/users/a60c8840d5b540448a139cea8b78b906` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:14.861036 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60c8840d5b540448a139cea8b78b906)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:14.863439 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:14.874014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1167/2326] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:14 2022] PUT /identity/v3/projects/a28672bd478c4599aed44d7506edf982/users/c3108d9b61d246538790a8b75ae5fee0/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:14.879711 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58527ff-b8b7-4ab9-ac22-a955904ac6db admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:14.891354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:14.927805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60c8840d5b540448a139cea8b78b906'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:14.945816 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60c8840d5b540448a139cea8b78b906'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:14.946706 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60c8840d5b540448a139cea8b78b906'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:14.960885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60c8840d5b540448a139cea8b78b906'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:14.964852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4c21bdae-8aa4-42db-b2c5-c38b89532add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60c8840d5b540448a139cea8b78b906'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:14.987610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58527ff-b8b7-4ab9-ac22-a955904ac6db admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:14.989044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1160/2327] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:14 2022] DELETE /identity/v3/users/a60c8840d5b540448a139cea8b78b906 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:14.994396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6398c-8fc2-4531-9344-f13bd5a0ef67 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:14.994895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6398c-8fc2-4531-9344-f13bd5a0ef67 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:14.995263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6398c-8fc2-4531-9344-f13bd5a0ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:15.023350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f1c6398c-8fc2-4531-9344-f13bd5a0ef67 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:15.024783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f1c6398c-8fc2-4531-9344-f13bd5a0ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:15.070140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:15.071200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:15.071663 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:15.072099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:15.073026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:15.074947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:15.090106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1168/2328] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:15.094699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:15.097158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:15.109005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:15.113221 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1161/2329] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:15.113750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94233f8d-87e9-4cfb-8f1b-2afad7348a8d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:15.121112 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d06ae3-8369-4487-b72a-d3cfe278cd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:15.122182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d06ae3-8369-4487-b72a-d3cfe278cd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:15.122784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d06ae3-8369-4487-b72a-d3cfe278cd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:15.123240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d06ae3-8369-4487-b72a-d3cfe278cd76 admin admin] PATH_INFO: `/v3/projects/a28672bd478c4599aed44d7506edf982/users/c3108d9b61d246538790a8b75ae5fee0/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:15.125831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6398c-8fc2-4531-9344-f13bd5a0ef67 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:15.126101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d06ae3-8369-4487-b72a-d3cfe278cd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28672bd478c4599aed44d7506edf982, user_id=c3108d9b61d246538790a8b75ae5fee0, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:15.127257 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f1c6398c-8fc2-4531-9344-f13bd5a0ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:15.129592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d06ae3-8369-4487-b72a-d3cfe278cd76 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:15.145567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1169/2330] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:15 2022] PUT /identity/v3/projects/a28672bd478c4599aed44d7506edf982/users/c3108d9b61d246538790a8b75ae5fee0/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:15.156108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16f625-1317-4f37-aae3-fb4d03ac69ab None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:15.156402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16f625-1317-4f37-aae3-fb4d03ac69ab None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:15.156681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16f625-1317-4f37-aae3-fb4d03ac69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:15.194172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7e16f625-1317-4f37-aae3-fb4d03ac69ab None None] MFA Rules not processed for user `c3108d9b61d246538790a8b75ae5fee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:15.195593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7e16f625-1317-4f37-aae3-fb4d03ac69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:15.219508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6398c-8fc2-4531-9344-f13bd5a0ef67 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:15.290404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1170/2331] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:15.292254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:15.292655 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:15.293029 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:15.293391 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:15.298590 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16f625-1317-4f37-aae3-fb4d03ac69ab None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:15.303728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7e16f625-1317-4f37-aae3-fb4d03ac69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:15.304656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:15.372815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:15.374638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:15.387406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1162/2332] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:06:15.395189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16f625-1317-4f37-aae3-fb4d03ac69ab None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:15.400357 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420585b-b580-4e41-96a9-edf72eef5f95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:15.401270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420585b-b580-4e41-96a9-edf72eef5f95 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:15.401821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420585b-b580-4e41-96a9-edf72eef5f95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:15.402448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420585b-b580-4e41-96a9-edf72eef5f95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:15.420835 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420585b-b580-4e41-96a9-edf72eef5f95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:15.422564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420585b-b580-4e41-96a9-edf72eef5f95 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:15.438056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1171/2333] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:06:15.764721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:15.766519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:15.783025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84c474-5638-47a1-a630-f1a0b912e591 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:15.790964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:15.791599 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:15.792275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:15.792275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] PATH_INFO: `/v3/projects/9c6679084def49788e9f250f8f950cd7` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:15.793240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6679084def49788e9f250f8f950cd7)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:15.795182 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:15.853247 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6679084def49788e9f250f8f950cd7', 'request_id': 'req-1ade6632-d840-42f0-96df-216d46524ee0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:15.859197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6679084def49788e9f250f8f950cd7', 'request_id': 'req-1ade6632-d840-42f0-96df-216d46524ee0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:15.867072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6679084def49788e9f250f8f950cd7', 'request_id': 'req-1ade6632-d840-42f0-96df-216d46524ee0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:15.883570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] The token cache is being invalidate because project 9c6679084def49788e9f250f8f950cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:15.884049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:15.884866 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:15.889855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1163/2334] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:15 2022] DELETE /identity/v3/projects/9c6679084def49788e9f250f8f950cd7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:15.891274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420585b-b580-4e41-96a9-edf72eef5f95 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:15.904331 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420585b-b580-4e41-96a9-edf72eef5f95 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:15.986529 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:15.987188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:15.988077 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:15.988592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] PATH_INFO: `/v3/users/a67c1371031d4063b09a0729bbc42dba` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:15.991507 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67c1371031d4063b09a0729bbc42dba)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:15.993722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:16.003161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:16.004918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:16.020060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade6632-d840-42f0-96df-216d46524ee0 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:16.024628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:16.025811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:16.028101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.028101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.028101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] PATH_INFO: `/v3/users/32abb029b9134a0aae2ec3fd9251ecd0` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.029324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32abb029b9134a0aae2ec3fd9251ecd0)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:16.031588 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:16.067696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67c1371031d4063b09a0729bbc42dba'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.085933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67c1371031d4063b09a0729bbc42dba'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.088344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67c1371031d4063b09a0729bbc42dba'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.099226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67c1371031d4063b09a0729bbc42dba'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.099864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-995349af-2f91-417a-bf54-dea6762fedac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67c1371031d4063b09a0729bbc42dba'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.101039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32abb029b9134a0aae2ec3fd9251ecd0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.120417 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32abb029b9134a0aae2ec3fd9251ecd0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.120417 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32abb029b9134a0aae2ec3fd9251ecd0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.121954 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1172/2335] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:15 2022] DELETE /identity/v3/users/a67c1371031d4063b09a0729bbc42dba => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:16.128546 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32abb029b9134a0aae2ec3fd9251ecd0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.129786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32abb029b9134a0aae2ec3fd9251ecd0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.145437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1164/2336] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:16 2022] DELETE /identity/v3/users/32abb029b9134a0aae2ec3fd9251ecd0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:16.152417 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47acb3-a50c-44c0-b61a-f8b71d4c1e09 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.152828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47acb3-a50c-44c0-b61a-f8b71d4c1e09 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.153209 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47acb3-a50c-44c0-b61a-f8b71d4c1e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.174650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-9b47acb3-a50c-44c0-b61a-f8b71d4c1e09 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:16.176317 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9b47acb3-a50c-44c0-b61a-f8b71d4c1e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:16.270000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1173/2337] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:16.280277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:16.281942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:16.290132 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:16.361137 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cd5f4-9c44-4969-8154-5872e4119d3a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:16.365242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13d0ac-b527-471d-8376-003ddb0150a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:16.366155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d0ac-b527-471d-8376-003ddb0150a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.366503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d0ac-b527-471d-8376-003ddb0150a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.366851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d0ac-b527-471d-8376-003ddb0150a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.379719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13d0ac-b527-471d-8376-003ddb0150a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:16.382025 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13d0ac-b527-471d-8376-003ddb0150a1 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:16.394592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1165/2338] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:16.483864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47acb3-a50c-44c0-b61a-f8b71d4c1e09 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:16.483864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-9b47acb3-a50c-44c0-b61a-f8b71d4c1e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:16.511697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47acb3-a50c-44c0-b61a-f8b71d4c1e09 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:16.521794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:16.523135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.523404 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.523683 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] PATH_INFO: `/v3/projects/7afeca3d32844a6c8ba0abc4fb13dd6e` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.526796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7afeca3d32844a6c8ba0abc4fb13dd6e)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:16.526796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:16.610739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7afeca3d32844a6c8ba0abc4fb13dd6e', 'request_id': 'req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.619220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7afeca3d32844a6c8ba0abc4fb13dd6e', 'request_id': 'req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.627925 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7afeca3d32844a6c8ba0abc4fb13dd6e', 'request_id': 'req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.645724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] The token cache is being invalidate because project 7afeca3d32844a6c8ba0abc4fb13dd6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:16.646351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.647772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.650380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1174/2339] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:16 2022] DELETE /identity/v3/projects/7afeca3d32844a6c8ba0abc4fb13dd6e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:16.655513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8fb3-716b-4adb-9c84-094cf270e133 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.655987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8fb3-716b-4adb-9c84-094cf270e133 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.656377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8fb3-716b-4adb-9c84-094cf270e133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.681679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d47c8fb3-716b-4adb-9c84-094cf270e133 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:16.683044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d47c8fb3-716b-4adb-9c84-094cf270e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:16.754122 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:16.755595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:16.765104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1166/2340] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:16.772075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebe35-9152-4527-9c64-8f56f4643ca9 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.772243 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebe35-9152-4527-9c64-8f56f4643ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.772492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebe35-9152-4527-9c64-8f56f4643ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.786778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c5ebb-fa51-45c7-8d3b-bd9d24e3c214 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:16.797765 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-f1cebe35-9152-4527-9c64-8f56f4643ca9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:16.799483 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f1cebe35-9152-4527-9c64-8f56f4643ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:16.801096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:16.801838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.802046 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.802772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] PATH_INFO: `/v3/projects/691da4d25a55474aa7575f3d2ce2fefc` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.804457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=691da4d25a55474aa7575f3d2ce2fefc)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:16.806533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:16.809539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1167/2341] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:16.813824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cebe35-9152-4527-9c64-8f56f4643ca9 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:16.826576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cebe35-9152-4527-9c64-8f56f4643ca9 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:16.831234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:16.834242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:16.835004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.835377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.836233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.837117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:16.837669 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:16.840175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:16.858791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1168/2342] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:06:16.862878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:16.874158 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691da4d25a55474aa7575f3d2ce2fefc', 'request_id': 'req-fce3b662-8503-4003-bb30-0bfd2007ae3a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.875618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa2eb7-980b-449c-a00b-c189e832143a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:16.884078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691da4d25a55474aa7575f3d2ce2fefc', 'request_id': 'req-fce3b662-8503-4003-bb30-0bfd2007ae3a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.892096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691da4d25a55474aa7575f3d2ce2fefc', 'request_id': 'req-fce3b662-8503-4003-bb30-0bfd2007ae3a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.911472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] The token cache is being invalidate because project 691da4d25a55474aa7575f3d2ce2fefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:16.911875 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.913459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:16.915316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1175/2343] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:16 2022] DELETE /identity/v3/projects/691da4d25a55474aa7575f3d2ce2fefc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:06:16.919269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:16.920686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:16.946063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:16.946352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:16.946600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:16.946876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:16.947518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:16.950064 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:16.997960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1169/2344] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:16 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:06:16.998916 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:17.000673 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:17.013534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3b662-8503-4003-bb30-0bfd2007ae3a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:17.016773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:17.080310 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640f9f-c4cc-49d7-8082-39ecd414df64 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:17.083676 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:17.084407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.084797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.085147 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] PATH_INFO: `/v3/users/c3108d9b61d246538790a8b75ae5fee0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.085571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106428-51be-4f91-8d5e-cb257dd8fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:17.086180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106428-51be-4f91-8d5e-cb257dd8fc52 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.086394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3108d9b61d246538790a8b75ae5fee0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:17.086505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106428-51be-4f91-8d5e-cb257dd8fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.086716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106428-51be-4f91-8d5e-cb257dd8fc52 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.087351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd106428-51be-4f91-8d5e-cb257dd8fc52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:17.088342 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:17.089398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd106428-51be-4f91-8d5e-cb257dd8fc52 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:17.119665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1170/2345] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:16 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:17.125476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106428-51be-4f91-8d5e-cb257dd8fc52 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:17.142067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106428-51be-4f91-8d5e-cb257dd8fc52 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:17.150204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c886f-be52-41f6-9ddb-fe630c16dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:17.150934 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c886f-be52-41f6-9ddb-fe630c16dac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.151191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c886f-be52-41f6-9ddb-fe630c16dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.151469 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c886f-be52-41f6-9ddb-fe630c16dac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.152127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c886f-be52-41f6-9ddb-fe630c16dac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:17.153950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c886f-be52-41f6-9ddb-fe630c16dac3 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:17.169114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1171/2346] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:17.170185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c886f-be52-41f6-9ddb-fe630c16dac3 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:17.172163 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3108d9b61d246538790a8b75ae5fee0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.181574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:17.181815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c886f-be52-41f6-9ddb-fe630c16dac3 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:17.189343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:17.190126 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.190509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.190887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.191665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:17.194328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:17.196871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3108d9b61d246538790a8b75ae5fee0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.199739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3108d9b61d246538790a8b75ae5fee0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.214539 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1172/2347] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:17.217086 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3108d9b61d246538790a8b75ae5fee0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.217872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-90921c09-5367-44aa-a500-23a03fe6b413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3108d9b61d246538790a8b75ae5fee0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.218385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:17.221212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:17.233909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1176/2348] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:16 2022] DELETE /identity/v3/users/c3108d9b61d246538790a8b75ae5fee0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:17.240999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608fab9-8bc9-492d-a4db-a22d8efd997f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:17.333668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:17.334456 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.334828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.335208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] PATH_INFO: `/v3/projects/1e93f4eaa32b417088ec00533cbe0c75/users/8996f570765d4098a616cc6e83b59b89/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.355203 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e93f4eaa32b417088ec00533cbe0c75, user_id=8996f570765d4098a616cc6e83b59b89, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:17.358157 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:17.382389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1173/2349] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:17 2022] PUT /identity/v3/projects/1e93f4eaa32b417088ec00533cbe0c75/users/8996f570765d4098a616cc6e83b59b89/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:17.388640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b52eb-9fbe-475a-bfa6-7a06e039b7c5 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.388939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b52eb-9fbe-475a-bfa6-7a06e039b7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.389183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b52eb-9fbe-475a-bfa6-7a06e039b7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.425973 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-538b52eb-9fbe-475a-bfa6-7a06e039b7c5 None None] MFA Rules not processed for user `8996f570765d4098a616cc6e83b59b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:17.427671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-538b52eb-9fbe-475a-bfa6-7a06e039b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:17.531595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1177/2350] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:17.547355 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:17.552675 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:17.570633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b52eb-9fbe-475a-bfa6-7a06e039b7c5 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:17.572040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-538b52eb-9fbe-475a-bfa6-7a06e039b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:17.630674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e5b91-8e51-48ce-8878-c913346d23b2 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:17.634894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559bbd-b349-461c-866d-9d2663ae7427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:17.635506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559bbd-b349-461c-866d-9d2663ae7427 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.635778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559bbd-b349-461c-866d-9d2663ae7427 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.636044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559bbd-b349-461c-866d-9d2663ae7427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.645991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559bbd-b349-461c-866d-9d2663ae7427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:17.647464 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559bbd-b349-461c-866d-9d2663ae7427 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:17.657475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1174/2351] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:17.661291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b52eb-9fbe-475a-bfa6-7a06e039b7c5 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:17.666860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:17.670070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.670070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.670594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] PATH_INFO: `/v3/projects/a28672bd478c4599aed44d7506edf982` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.671924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28672bd478c4599aed44d7506edf982)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:17.674768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:17.757395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28672bd478c4599aed44d7506edf982', 'request_id': 'req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.764598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28672bd478c4599aed44d7506edf982', 'request_id': 'req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.772336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28672bd478c4599aed44d7506edf982', 'request_id': 'req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.774365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:17.793542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] The token cache is being invalidate because project a28672bd478c4599aed44d7506edf982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:17.793542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.793542 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-03e388fb-7bc5-44e9-b59d-d257f0d1d5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:17.798089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1178/2352] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:17 2022] DELETE /identity/v3/projects/a28672bd478c4599aed44d7506edf982 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:17.799715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bcdc-e7de-40ea-8649-e97976fa653c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.799997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bcdc-e7de-40ea-8649-e97976fa653c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.800265 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2bcdc-e7de-40ea-8649-e97976fa653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.809747 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:17.827400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-78d2bcdc-e7de-40ea-8649-e97976fa653c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:17.828960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-78d2bcdc-e7de-40ea-8649-e97976fa653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:17.921652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1175/2353] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:17.927562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ff28b-fdbe-4a3d-91a5-caec98b060fe None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:17.927562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ff28b-fdbe-4a3d-91a5-caec98b060fe None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:17.927562 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ff28b-fdbe-4a3d-91a5-caec98b060fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:17.958007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fc5ff28b-fdbe-4a3d-91a5-caec98b060fe None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:17.960062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fc5ff28b-fdbe-4a3d-91a5-caec98b060fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:17.972775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1179/2354] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:17.974008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2bcdc-e7de-40ea-8649-e97976fa653c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:17.994960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2bcdc-e7de-40ea-8649-e97976fa653c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.002174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.004672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.004672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.004672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.004672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:18.004672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.006730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.024085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1176/2355] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:06:18.028444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ff28b-fdbe-4a3d-91a5-caec98b060fe None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.039093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ff28b-fdbe-4a3d-91a5-caec98b060fe None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.044210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1737e-6403-4c44-b144-38d7a1d29537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.045009 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1737e-6403-4c44-b144-38d7a1d29537 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.045436 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1737e-6403-4c44-b144-38d7a1d29537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.045894 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1737e-6403-4c44-b144-38d7a1d29537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.046838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1737e-6403-4c44-b144-38d7a1d29537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.049684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1737e-6403-4c44-b144-38d7a1d29537 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.114398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1180/2356] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:18 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:18.118196 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.134304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025aecf-ad9f-4dd7-a586-82fba14e20eb admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.228800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ff935-5a50-496d-bb1b-f2528d18261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.229861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ff935-5a50-496d-bb1b-f2528d18261a admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.230299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ff935-5a50-496d-bb1b-f2528d18261a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.230860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ff935-5a50-496d-bb1b-f2528d18261a admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.231721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ff935-5a50-496d-bb1b-f2528d18261a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.233968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ff935-5a50-496d-bb1b-f2528d18261a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.267525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1177/2357] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:18 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:06:18.269155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1737e-6403-4c44-b144-38d7a1d29537 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.282476 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1737e-6403-4c44-b144-38d7a1d29537 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.288582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebe3a8-4916-44d2-9cf6-9b0c84598a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.289269 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebe3a8-4916-44d2-9cf6-9b0c84598a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.289647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebe3a8-4916-44d2-9cf6-9b0c84598a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.290000 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebe3a8-4916-44d2-9cf6-9b0c84598a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.290752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebe3a8-4916-44d2-9cf6-9b0c84598a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.292652 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebe3a8-4916-44d2-9cf6-9b0c84598a0d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.307173 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1181/2358] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:18.311263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ff935-5a50-496d-bb1b-f2528d18261a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.322820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ff935-5a50-496d-bb1b-f2528d18261a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.328262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424aac9-8fca-414c-a77d-8486fa86a490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.328958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424aac9-8fca-414c-a77d-8486fa86a490 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.329579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424aac9-8fca-414c-a77d-8486fa86a490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.329922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424aac9-8fca-414c-a77d-8486fa86a490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.330750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424aac9-8fca-414c-a77d-8486fa86a490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.332389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424aac9-8fca-414c-a77d-8486fa86a490 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.344452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1178/2359] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:18.348657 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebe3a8-4916-44d2-9cf6-9b0c84598a0d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.359414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebe3a8-4916-44d2-9cf6-9b0c84598a0d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.364429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46264f-93af-48cd-9cd6-7854e86444a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.365144 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46264f-93af-48cd-9cd6-7854e86444a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.365514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46264f-93af-48cd-9cd6-7854e86444a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.365851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46264f-93af-48cd-9cd6-7854e86444a4 admin admin] PATH_INFO: `/v3/projects/0ba86ed36e2e465280a066f71204d823/users/2bf0448f846547f08a7634fbe5bfebe6/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.382534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46264f-93af-48cd-9cd6-7854e86444a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba86ed36e2e465280a066f71204d823, user_id=2bf0448f846547f08a7634fbe5bfebe6, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.385375 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46264f-93af-48cd-9cd6-7854e86444a4 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.408459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1182/2360] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:18 2022] PUT /identity/v3/projects/0ba86ed36e2e465280a066f71204d823/users/2bf0448f846547f08a7634fbe5bfebe6/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:18.410795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c785f-0425-407b-a389-51703c60df32 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.411078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c785f-0425-407b-a389-51703c60df32 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.411344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c785f-0425-407b-a389-51703c60df32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.440237 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d44c785f-0425-407b-a389-51703c60df32 None None] MFA Rules not processed for user `2bf0448f846547f08a7634fbe5bfebe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:18.441834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d44c785f-0425-407b-a389-51703c60df32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:18.512412 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:18.516671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1179/2361] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:18.527006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46264f-93af-48cd-9cd6-7854e86444a4 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.597668 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46264f-93af-48cd-9cd6-7854e86444a4 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.602497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3f985-9682-41a1-980f-f89717ac519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.603812 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f985-9682-41a1-980f-f89717ac519a admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.604094 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f985-9682-41a1-980f-f89717ac519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.604365 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f985-9682-41a1-980f-f89717ac519a admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.604995 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f985-9682-41a1-980f-f89717ac519a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.606934 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3f985-9682-41a1-980f-f89717ac519a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.634796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1183/2362] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:18 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:18.638795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c785f-0425-407b-a389-51703c60df32 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.651078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c785f-0425-407b-a389-51703c60df32 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.710862 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc800b2-63ed-43cb-8155-27b1f8759c6d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.711057 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5870b-8c25-415e-bb98-1cebf5530812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.711184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc800b2-63ed-43cb-8155-27b1f8759c6d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.711407 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc800b2-63ed-43cb-8155-27b1f8759c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.711526 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5870b-8c25-415e-bb98-1cebf5530812 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.711734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5870b-8c25-415e-bb98-1cebf5530812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.711999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5870b-8c25-415e-bb98-1cebf5530812 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.712635 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5870b-8c25-415e-bb98-1cebf5530812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.714572 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5870b-8c25-415e-bb98-1cebf5530812 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.730958 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-fbc800b2-63ed-43cb-8155-27b1f8759c6d None None] MFA Rules not processed for user `75c10f4846c2498e8cc93a3c3c5ecdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:18.732245 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-fbc800b2-63ed-43cb-8155-27b1f8759c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:18.738820 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1180/2363] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:18 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:18.743304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5870b-8c25-415e-bb98-1cebf5530812 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.753216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5870b-8c25-415e-bb98-1cebf5530812 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.758518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996000-2513-4b68-8bf6-abbb3848b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.759222 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996000-2513-4b68-8bf6-abbb3848b388 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.759610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996000-2513-4b68-8bf6-abbb3848b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.759883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996000-2513-4b68-8bf6-abbb3848b388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.760522 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd996000-2513-4b68-8bf6-abbb3848b388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.762124 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd996000-2513-4b68-8bf6-abbb3848b388 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.775217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1181/2364] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:06:18.776125 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996000-2513-4b68-8bf6-abbb3848b388 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.785431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996000-2513-4b68-8bf6-abbb3848b388 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.789184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1184/2365] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:18.793316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cc4cb-9a8c-48a4-8c8d-8a8e126c5dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.793993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cc4cb-9a8c-48a4-8c8d-8a8e126c5dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.794270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cc4cb-9a8c-48a4-8c8d-8a8e126c5dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.794541 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cc4cb-9a8c-48a4-8c8d-8a8e126c5dd6 admin admin] PATH_INFO: `/v3/projects/031d097d79a7489b897bef1e3c541e17/users/d26c70188cea4217ae69b8d1fe3d2d57/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.810003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cc4cb-9a8c-48a4-8c8d-8a8e126c5dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031d097d79a7489b897bef1e3c541e17, user_id=d26c70188cea4217ae69b8d1fe3d2d57, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.812639 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cc4cb-9a8c-48a4-8c8d-8a8e126c5dd6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.827586 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1182/2366] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:18 2022] PUT /identity/v3/projects/031d097d79a7489b897bef1e3c541e17/users/d26c70188cea4217ae69b8d1fe3d2d57/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:18.831616 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc800b2-63ed-43cb-8155-27b1f8759c6d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.842559 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc800b2-63ed-43cb-8155-27b1f8759c6d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.855203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:18.904266 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928071a-69c0-4316-8569-8bb10f280b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.904892 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928071a-69c0-4316-8569-8bb10f280b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.905171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928071a-69c0-4316-8569-8bb10f280b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.905444 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928071a-69c0-4316-8569-8bb10f280b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.906161 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928071a-69c0-4316-8569-8bb10f280b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.907793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928071a-69c0-4316-8569-8bb10f280b02 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.921325 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1185/2367] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:18.922726 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cc4cb-9a8c-48a4-8c8d-8a8e126c5dd6 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:18.933824 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cc4cb-9a8c-48a4-8c8d-8a8e126c5dd6 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:18.938495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:18.939277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.939556 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.939827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] PATH_INFO: `/v3/projects/031d097d79a7489b897bef1e3c541e17/users/d26c70188cea4217ae69b8d1fe3d2d57/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:18.941887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=031d097d79a7489b897bef1e3c541e17, user_id=d26c70188cea4217ae69b8d1fe3d2d57, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:18.945105 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:18.956233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1183/2368] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:18 2022] PUT /identity/v3/projects/031d097d79a7489b897bef1e3c541e17/users/d26c70188cea4217ae69b8d1fe3d2d57/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:18.967956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533735-f0f5-4ac8-8889-b67b2cb38479 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:18.968243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533735-f0f5-4ac8-8889-b67b2cb38479 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:18.968672 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d533735-f0f5-4ac8-8889-b67b2cb38479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:19.003582 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-4d533735-f0f5-4ac8-8889-b67b2cb38479 None None] MFA Rules not processed for user `d26c70188cea4217ae69b8d1fe3d2d57`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:19.004817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4d533735-f0f5-4ac8-8889-b67b2cb38479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:19.079398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1186/2369] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:19.090767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:19.092605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:19.158077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ad1f1-d5c3-43da-a92d-94aee4238cee admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:19.163913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:19.164793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:19.164793 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:19.165046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:19.229729 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:19.231738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:19.233244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:19.245148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1184/2370] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:25.620464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0fcae-1bb3-47df-8a5e-a43e2f413f11 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:25.620976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0fcae-1bb3-47df-8a5e-a43e2f413f11 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:25.620976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0fcae-1bb3-47df-8a5e-a43e2f413f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:25.641535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-f5a0fcae-1bb3-47df-8a5e-a43e2f413f11 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:25.642738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f5a0fcae-1bb3-47df-8a5e-a43e2f413f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:25.702492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1187/2371] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:25.717050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:25.718339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:25.804462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311639f0-0e1f-48af-a8f8-19ab9e11a8db service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:25.810407 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:25.811012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:25.811286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:25.811555 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:25.833370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:25.835771 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:25.849682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1185/2372] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:06:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:30.195921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0fcae-1bb3-47df-8a5e-a43e2f413f11 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:30.197387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f5a0fcae-1bb3-47df-8a5e-a43e2f413f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:30.215183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0fcae-1bb3-47df-8a5e-a43e2f413f11 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:30.237409 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:30.238080 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:30.238372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:30.238625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:30.253710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:30.255460 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:30.269658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1188/2373] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:35.841932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=34 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:40.263457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=86 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:46.120168 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:46.121951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:46.237208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bd69e-7ea9-4087-8032-831b4c3549ba service swift] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:46.246608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:46.247659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:46.248004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:46.248342 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:46.250714 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:46.270213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:46.272787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:46.290710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1186/2374] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:47.722944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:47.724364 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:47.780888 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31524724-a51a-414a-a889-9ee2b7787824 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:47.784387 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91198727-6e5d-4849-bf5b-6d05d951d9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:47.784989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91198727-6e5d-4849-bf5b-6d05d951d9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:47.785262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91198727-6e5d-4849-bf5b-6d05d951d9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:47.785558 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91198727-6e5d-4849-bf5b-6d05d951d9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:47.787244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-91198727-6e5d-4849-bf5b-6d05d951d9a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:47.846602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91198727-6e5d-4849-bf5b-6d05d951d9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:47.848012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91198727-6e5d-4849-bf5b-6d05d951d9a8 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:47.857745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1189/2375] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:48.452274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:48.453851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:48.466895 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd560f-1544-45ac-b208-55fa8876cbe0 service nova] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:48.471752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:48.472491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:48.472833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:48.473209 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] PATH_INFO: `/v3/users/8996f570765d4098a616cc6e83b59b89` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:48.474927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8996f570765d4098a616cc6e83b59b89)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:48.476825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:48.530507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8996f570765d4098a616cc6e83b59b89'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:48.545197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8996f570765d4098a616cc6e83b59b89'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:48.546303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8996f570765d4098a616cc6e83b59b89'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:48.555467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8996f570765d4098a616cc6e83b59b89'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:48.556375 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8996f570765d4098a616cc6e83b59b89'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:48.570985 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1187/2376] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:48 2022] DELETE /identity/v3/users/8996f570765d4098a616cc6e83b59b89 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:06:48.576189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0bbc-b3c7-46db-a958-ebf85f6aecba None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:48.576631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0bbc-b3c7-46db-a958-ebf85f6aecba None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:48.576907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0bbc-b3c7-46db-a958-ebf85f6aecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:48.596557 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-ca0a0bbc-b3c7-46db-a958-ebf85f6aecba None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:48.597802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ca0a0bbc-b3c7-46db-a958-ebf85f6aecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:48.665062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1190/2377] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:48.674947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:48.676536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:48.743325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81c28-2027-4fe2-84ad-640575882197 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:48.748028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747344de-95f3-4754-bd1b-75d830c18427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:48.748637 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747344de-95f3-4754-bd1b-75d830c18427 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:48.748910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747344de-95f3-4754-bd1b-75d830c18427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:48.749177 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747344de-95f3-4754-bd1b-75d830c18427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:48.760027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747344de-95f3-4754-bd1b-75d830c18427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:48.761832 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747344de-95f3-4754-bd1b-75d830c18427 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:48.769365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:48.776431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1188/2378] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:49.438483 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0bbc-b3c7-46db-a958-ebf85f6aecba None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:49.440059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ca0a0bbc-b3c7-46db-a958-ebf85f6aecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:49.452722 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0bbc-b3c7-46db-a958-ebf85f6aecba None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:49.470101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:49.471376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:49.471376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:49.471376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] PATH_INFO: `/v3/projects/1e93f4eaa32b417088ec00533cbe0c75` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:49.472978 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e93f4eaa32b417088ec00533cbe0c75)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:49.475010 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:49.541665 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:49.547207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e93f4eaa32b417088ec00533cbe0c75', 'request_id': 'req-aa8a8e45-570c-45fd-bf42-cb308f018ab3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:49.554232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e93f4eaa32b417088ec00533cbe0c75', 'request_id': 'req-aa8a8e45-570c-45fd-bf42-cb308f018ab3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:49.563665 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e93f4eaa32b417088ec00533cbe0c75', 'request_id': 'req-aa8a8e45-570c-45fd-bf42-cb308f018ab3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:49.581022 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] The token cache is being invalidate because project 1e93f4eaa32b417088ec00533cbe0c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:49.581316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:49.582264 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-aa8a8e45-570c-45fd-bf42-cb308f018ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:49.584955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1191/2379] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:49 2022] DELETE /identity/v3/projects/1e93f4eaa32b417088ec00533cbe0c75 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:49.590046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca734576-3bc2-477c-a171-60a4533cb701 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:49.591203 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca734576-3bc2-477c-a171-60a4533cb701 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:49.591749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca734576-3bc2-477c-a171-60a4533cb701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:49.616528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ca734576-3bc2-477c-a171-60a4533cb701 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:49.618242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ca734576-3bc2-477c-a171-60a4533cb701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:49.762544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1189/2380] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:49.835515 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d958e1-ac7b-4025-bedb-54e777705ce1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:49.836066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d958e1-ac7b-4025-bedb-54e777705ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:49.836066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d958e1-ac7b-4025-bedb-54e777705ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:49.881442 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-75d958e1-ac7b-4025-bedb-54e777705ce1 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:49.883322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-75d958e1-ac7b-4025-bedb-54e777705ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:49.894415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1192/2381] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:49.899362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca734576-3bc2-477c-a171-60a4533cb701 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:49.912613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca734576-3bc2-477c-a171-60a4533cb701 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:49.918828 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:49.919326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:49.919770 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:49.919998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:49.920806 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:49.921119 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:49.922991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:49.956309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1190/2382] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:06:49.961015 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d958e1-ac7b-4025-bedb-54e777705ce1 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:49.981728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d958e1-ac7b-4025-bedb-54e777705ce1 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:50.001707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d668-0b46-4b09-acf9-b3b47f529c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:50.002347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d668-0b46-4b09-acf9-b3b47f529c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:50.002624 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d668-0b46-4b09-acf9-b3b47f529c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:50.002899 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d668-0b46-4b09-acf9-b3b47f529c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:50.003537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044d668-0b46-4b09-acf9-b3b47f529c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:50.006118 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044d668-0b46-4b09-acf9-b3b47f529c4e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:50.053335 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1193/2383] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:49 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:50.054613 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:50.071475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5252cb-5a3b-4045-aaee-68b633886f0e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:50.144580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62b40-8198-4f6d-bbee-540f44b95e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:50.146817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62b40-8198-4f6d-bbee-540f44b95e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:50.147777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62b40-8198-4f6d-bbee-540f44b95e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:50.148217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62b40-8198-4f6d-bbee-540f44b95e24 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:50.149081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea62b40-8198-4f6d-bbee-540f44b95e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:50.152008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea62b40-8198-4f6d-bbee-540f44b95e24 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:50.186100 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1191/2384] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:50 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:50.186808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d668-0b46-4b09-acf9-b3b47f529c4e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:50.199096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d668-0b46-4b09-acf9-b3b47f529c4e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:50.204085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedba32-a0f9-457f-9c86-b582a3ac351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:50.204791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedba32-a0f9-457f-9c86-b582a3ac351e admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:50.205131 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedba32-a0f9-457f-9c86-b582a3ac351e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:50.205743 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedba32-a0f9-457f-9c86-b582a3ac351e admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:50.206210 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedba32-a0f9-457f-9c86-b582a3ac351e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:50.207876 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedba32-a0f9-457f-9c86-b582a3ac351e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:50.222168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1194/2385] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:06:50.223326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62b40-8198-4f6d-bbee-540f44b95e24 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:50.233420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62b40-8198-4f6d-bbee-540f44b95e24 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:50.238365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd0b1e-676e-4e31-bc38-4234a1b0e212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:50.238974 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd0b1e-676e-4e31-bc38-4234a1b0e212 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:50.239252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd0b1e-676e-4e31-bc38-4234a1b0e212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:50.239524 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd0b1e-676e-4e31-bc38-4234a1b0e212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:50.240690 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd0b1e-676e-4e31-bc38-4234a1b0e212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:50.242388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd0b1e-676e-4e31-bc38-4234a1b0e212 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:50.253350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1192/2386] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:50.257959 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedba32-a0f9-457f-9c86-b582a3ac351e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:50.268697 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedba32-a0f9-457f-9c86-b582a3ac351e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:50.277628 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:50.278579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:50.279102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:50.279815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] PATH_INFO: `/v3/projects/ced93fb9d5dd4cbda0272ba5477b39c9/users/52ef0190e0854ed1b9b1e08224e7390d/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:50.299043 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced93fb9d5dd4cbda0272ba5477b39c9, user_id=52ef0190e0854ed1b9b1e08224e7390d, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:50.301519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:50.316778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1195/2387] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:50 2022] PUT /identity/v3/projects/ced93fb9d5dd4cbda0272ba5477b39c9/users/52ef0190e0854ed1b9b1e08224e7390d/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:50.322191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df63e77-fdc9-4fde-b564-e87f5c731110 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:50.322474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df63e77-fdc9-4fde-b564-e87f5c731110 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:50.322772 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df63e77-fdc9-4fde-b564-e87f5c731110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:50.342760 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0df63e77-fdc9-4fde-b564-e87f5c731110 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:50.344748 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0df63e77-fdc9-4fde-b564-e87f5c731110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:50.425641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1193/2388] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:50.433955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:50.435622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:50.514123 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384def5-ba28-4c7c-8edf-5fc4b4d4212c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:50.521287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:50.521989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:50.522268 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:50.523710 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:50.533264 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:50.534839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:50.546002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1196/2389] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:06:51.552893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7fe0d-ed2e-4272-bbda-8a61066e4c24 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:51.552893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7fe0d-ed2e-4272-bbda-8a61066e4c24 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:51.553460 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7fe0d-ed2e-4272-bbda-8a61066e4c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:51.577009 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:51.602120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-79c7fe0d-ed2e-4272-bbda-8a61066e4c24 None None] MFA Rules not processed for user `52ef0190e0854ed1b9b1e08224e7390d`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:51.609007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-79c7fe0d-ed2e-4272-bbda-8a61066e4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:51.727481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1194/2390] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:51.738439 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:51.741583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:51.805039 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847cb9a-8ee3-44ba-9680-846f0a1272e9 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:51.808684 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e7273-8e62-4328-854c-bfc7e5ceeaed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:51.809299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e7273-8e62-4328-854c-bfc7e5ceeaed service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:51.809600 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e7273-8e62-4328-854c-bfc7e5ceeaed service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:51.809873 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e7273-8e62-4328-854c-bfc7e5ceeaed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:51.818800 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e7273-8e62-4328-854c-bfc7e5ceeaed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:51.820227 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e7273-8e62-4328-854c-bfc7e5ceeaed service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:51.829218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1197/2391] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:52.896022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7fe0d-ed2e-4272-bbda-8a61066e4c24 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:52.897862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-79c7fe0d-ed2e-4272-bbda-8a61066e4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:52.913429 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7fe0d-ed2e-4272-bbda-8a61066e4c24 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:52.918123 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:52.918857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:52.919223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:52.919559 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] PATH_INFO: `/v3/users/26a54235fb424dfd825b2de9f7aaa006` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:52.920746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a54235fb424dfd825b2de9f7aaa006)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:52.922698 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:52.968358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a54235fb424dfd825b2de9f7aaa006'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:52.984240 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a54235fb424dfd825b2de9f7aaa006'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:52.985258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a54235fb424dfd825b2de9f7aaa006'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:52.994411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a54235fb424dfd825b2de9f7aaa006'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:52.995465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-7eb717a7-8c65-494a-8f45-307201bd6ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a54235fb424dfd825b2de9f7aaa006'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:53.009963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1195/2392] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:52 2022] DELETE /identity/v3/users/26a54235fb424dfd825b2de9f7aaa006 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:53.218724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e7273-8e62-4328-854c-bfc7e5ceeaed service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:53.231134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e7273-8e62-4328-854c-bfc7e5ceeaed service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:53.244405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:53.295598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:53.296231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.296503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.296771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] PATH_INFO: `/v3/projects/5d716a28995942e788205c1ad1e83bb3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.297928 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d716a28995942e788205c1ad1e83bb3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:53.299849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:53.353279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d716a28995942e788205c1ad1e83bb3', 'request_id': 'req-efe65f8e-c028-498e-b703-6ea71c2903b8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:53.360347 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d716a28995942e788205c1ad1e83bb3', 'request_id': 'req-efe65f8e-c028-498e-b703-6ea71c2903b8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:53.371320 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d716a28995942e788205c1ad1e83bb3', 'request_id': 'req-efe65f8e-c028-498e-b703-6ea71c2903b8'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:53.379048 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb730f-a5ae-4767-94c2-fda9c891ba51 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.379331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb730f-a5ae-4767-94c2-fda9c891ba51 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.380004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb730f-a5ae-4767-94c2-fda9c891ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.384819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] The token cache is being invalidate because project 5d716a28995942e788205c1ad1e83bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:53.385114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:53.385769 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-efe65f8e-c028-498e-b703-6ea71c2903b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:53.387289 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1198/2393] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:53 2022] DELETE /identity/v3/projects/5d716a28995942e788205c1ad1e83bb3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:53.392631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c2db2-b5f5-4be4-bf0d-1b81431de1c4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.393078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c2db2-b5f5-4be4-bf0d-1b81431de1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.393451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c2db2-b5f5-4be4-bf0d-1b81431de1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.400693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c6cb730f-a5ae-4767-94c2-fda9c891ba51 None None] MFA Rules not processed for user `52ef0190e0854ed1b9b1e08224e7390d`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:53.401919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c6cb730f-a5ae-4767-94c2-fda9c891ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:53.415878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-cb1c2db2-b5f5-4be4-bf0d-1b81431de1c4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:53.417185 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-cb1c2db2-b5f5-4be4-bf0d-1b81431de1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:53.459585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1196/2394] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:53.489141 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1199/2395] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:53.496869 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eef3e-4c02-4815-813c-dab2dc726592 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.497153 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eef3e-4c02-4815-813c-dab2dc726592 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.497423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eef3e-4c02-4815-813c-dab2dc726592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.517995 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-125eef3e-4c02-4815-813c-dab2dc726592 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:53.519262 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-125eef3e-4c02-4815-813c-dab2dc726592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:53.528462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1197/2396] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:53.532790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c2db2-b5f5-4be4-bf0d-1b81431de1c4 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:53.543215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c2db2-b5f5-4be4-bf0d-1b81431de1c4 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:53.548247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:53.548975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.549257 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.549567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.550207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:53.550514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:53.552137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:53.571503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1200/2397] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:06:53.572924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eef3e-4c02-4815-813c-dab2dc726592 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:53.583756 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eef3e-4c02-4815-813c-dab2dc726592 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:53.588804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851982ad-6aeb-4f68-9a9e-a538aef966e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:53.589467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851982ad-6aeb-4f68-9a9e-a538aef966e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.589787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851982ad-6aeb-4f68-9a9e-a538aef966e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.590109 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851982ad-6aeb-4f68-9a9e-a538aef966e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.590759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851982ad-6aeb-4f68-9a9e-a538aef966e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:53.592708 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851982ad-6aeb-4f68-9a9e-a538aef966e0 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:53.597722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:53.628199 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1198/2398] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:53 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:53.629346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:53.640249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183beb0-1777-4dab-87ff-63d16c8764a0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:53.671467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:53.706183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96a4e-5478-4640-9edd-374b64cff939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:53.706810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96a4e-5478-4640-9edd-374b64cff939 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.707089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96a4e-5478-4640-9edd-374b64cff939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.707363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96a4e-5478-4640-9edd-374b64cff939 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.708061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b96a4e-5478-4640-9edd-374b64cff939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:53.711314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b96a4e-5478-4640-9edd-374b64cff939 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:53.737003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1201/2399] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:53 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:53.741286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851982ad-6aeb-4f68-9a9e-a538aef966e0 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:53.767018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851982ad-6aeb-4f68-9a9e-a538aef966e0 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:53.767018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418758-8d13-4dca-8a4c-68aa64df7fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:53.767018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418758-8d13-4dca-8a4c-68aa64df7fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.767018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418758-8d13-4dca-8a4c-68aa64df7fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.767401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418758-8d13-4dca-8a4c-68aa64df7fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.767401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3418758-8d13-4dca-8a4c-68aa64df7fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:53.767401 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3418758-8d13-4dca-8a4c-68aa64df7fb9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:53.778518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1199/2400] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:53.783384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96a4e-5478-4640-9edd-374b64cff939 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:53.794054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96a4e-5478-4640-9edd-374b64cff939 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:53.799127 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a6b14-b778-45e8-a99b-36729c603c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:53.800274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6b14-b778-45e8-a99b-36729c603c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.801160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6b14-b778-45e8-a99b-36729c603c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.801445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6b14-b778-45e8-a99b-36729c603c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.802336 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a6b14-b778-45e8-a99b-36729c603c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:53.804096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a6b14-b778-45e8-a99b-36729c603c95 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:53.815598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1202/2401] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:53.820270 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418758-8d13-4dca-8a4c-68aa64df7fb9 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:53.836018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418758-8d13-4dca-8a4c-68aa64df7fb9 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:53.847223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac8e16-702b-42c9-b9c0-9bd2f9e603b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:53.847893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8e16-702b-42c9-b9c0-9bd2f9e603b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.848167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8e16-702b-42c9-b9c0-9bd2f9e603b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.848440 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8e16-702b-42c9-b9c0-9bd2f9e603b8 admin admin] PATH_INFO: `/v3/projects/f3d1019d3400428d9e3ea15b6b602ba5/users/0497df6a213f4ccbbb9d1169d93fe6d5/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.874179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac8e16-702b-42c9-b9c0-9bd2f9e603b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d1019d3400428d9e3ea15b6b602ba5, user_id=0497df6a213f4ccbbb9d1169d93fe6d5, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:53.878638 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac8e16-702b-42c9-b9c0-9bd2f9e603b8 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:53.909053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1200/2402] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:53 2022] PUT /identity/v3/projects/f3d1019d3400428d9e3ea15b6b602ba5/users/0497df6a213f4ccbbb9d1169d93fe6d5/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:53.916740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa69a5-25c8-479b-879a-209eadf51ccb None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:53.916920 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa69a5-25c8-479b-879a-209eadf51ccb None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:53.917632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa69a5-25c8-479b-879a-209eadf51ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:53.963929 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-daaa69a5-25c8-479b-879a-209eadf51ccb None None] MFA Rules not processed for user `0497df6a213f4ccbbb9d1169d93fe6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:53.965670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-daaa69a5-25c8-479b-879a-209eadf51ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:54.059014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1203/2403] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:54.063197 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac8e16-702b-42c9-b9c0-9bd2f9e603b8 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:54.171238 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac8e16-702b-42c9-b9c0-9bd2f9e603b8 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:54.176634 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3d3ae-38e1-4272-8fc8-c3e82e88e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:54.177798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3d3ae-38e1-4272-8fc8-c3e82e88e4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.178082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3d3ae-38e1-4272-8fc8-c3e82e88e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.178281 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3d3ae-38e1-4272-8fc8-c3e82e88e4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.178932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3d3ae-38e1-4272-8fc8-c3e82e88e4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:54.180831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3d3ae-38e1-4272-8fc8-c3e82e88e4b4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:54.227233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1201/2404] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:54 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:06:54.232850 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa69a5-25c8-479b-879a-209eadf51ccb None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:54.250312 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa69a5-25c8-479b-879a-209eadf51ccb None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:54.353448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6d83d-88f4-4d4f-96fb-1f92965ca273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:54.355430 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6d83d-88f4-4d4f-96fb-1f92965ca273 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.355790 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6d83d-88f4-4d4f-96fb-1f92965ca273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.356283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6d83d-88f4-4d4f-96fb-1f92965ca273 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.356937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6d83d-88f4-4d4f-96fb-1f92965ca273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:54.359092 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6d83d-88f4-4d4f-96fb-1f92965ca273 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:54.390172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1204/2405] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:54 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:54.393176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3d3ae-38e1-4272-8fc8-c3e82e88e4b4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:54.408513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3d3ae-38e1-4272-8fc8-c3e82e88e4b4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:54.414487 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0adf8-0b4d-4081-837a-ba7b813a0cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:54.415215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0adf8-0b4d-4081-837a-ba7b813a0cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.415805 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0adf8-0b4d-4081-837a-ba7b813a0cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.416530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0adf8-0b4d-4081-837a-ba7b813a0cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.417373 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0adf8-0b4d-4081-837a-ba7b813a0cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:54.419251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0adf8-0b4d-4081-837a-ba7b813a0cb4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:54.433575 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1202/2406] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:54.438193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6d83d-88f4-4d4f-96fb-1f92965ca273 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:54.450653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6d83d-88f4-4d4f-96fb-1f92965ca273 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:54.455980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde28f-a15d-4492-aed8-07fb76917c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:54.456650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde28f-a15d-4492-aed8-07fb76917c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.456937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde28f-a15d-4492-aed8-07fb76917c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.457392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cde28f-a15d-4492-aed8-07fb76917c45 admin admin] PATH_INFO: `/v3/projects/0e130fe3aa9d40aaa4bae4771a46e3fa/users/169f0c2c896b422cbeb2e1fb45df6ab0/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.483296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde28f-a15d-4492-aed8-07fb76917c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e130fe3aa9d40aaa4bae4771a46e3fa, user_id=169f0c2c896b422cbeb2e1fb45df6ab0, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:54.486721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cde28f-a15d-4492-aed8-07fb76917c45 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:54.509322 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1205/2407] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:54 2022] PUT /identity/v3/projects/0e130fe3aa9d40aaa4bae4771a46e3fa/users/169f0c2c896b422cbeb2e1fb45df6ab0/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:54.513815 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0adf8-0b4d-4081-837a-ba7b813a0cb4 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:54.533003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0adf8-0b4d-4081-837a-ba7b813a0cb4 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:54.619370 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86456e-68e9-44ee-b01e-a353466499a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:54.620012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86456e-68e9-44ee-b01e-a353466499a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.620294 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86456e-68e9-44ee-b01e-a353466499a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.620709 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86456e-68e9-44ee-b01e-a353466499a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.621381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86456e-68e9-44ee-b01e-a353466499a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:54.623008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86456e-68e9-44ee-b01e-a353466499a4 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:54.638001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1203/2408] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:54.639254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde28f-a15d-4492-aed8-07fb76917c45 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:54.651105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cde28f-a15d-4492-aed8-07fb76917c45 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:54.656400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:54.657065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.657352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.657785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] PATH_INFO: `/v3/projects/0e130fe3aa9d40aaa4bae4771a46e3fa/users/169f0c2c896b422cbeb2e1fb45df6ab0/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.659762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e130fe3aa9d40aaa4bae4771a46e3fa, user_id=169f0c2c896b422cbeb2e1fb45df6ab0, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:54.663065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:54.665424 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:54.676490 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1206/2409] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:54 2022] PUT /identity/v3/projects/0e130fe3aa9d40aaa4bae4771a46e3fa/users/169f0c2c896b422cbeb2e1fb45df6ab0/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:54.688142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0de5d-8bf1-46de-9c8f-942317e4994e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.688438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0de5d-8bf1-46de-9c8f-942317e4994e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.688825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0de5d-8bf1-46de-9c8f-942317e4994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.721309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-1cc0de5d-8bf1-46de-9c8f-942317e4994e None None] MFA Rules not processed for user `169f0c2c896b422cbeb2e1fb45df6ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:54.725749 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1cc0de5d-8bf1-46de-9c8f-942317e4994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:54.738486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:54.783321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:54.785247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:54.833792 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1204/2410] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:54.852419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0de5d-8bf1-46de-9c8f-942317e4994e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:54.854300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1cc0de5d-8bf1-46de-9c8f-942317e4994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:54.893861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5fabe-1023-43c7-a712-eaaddc4f6e08 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:54.902132 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:54.902963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.903239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.903770 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.905733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:54.938834 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0de5d-8bf1-46de-9c8f-942317e4994e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:54.943519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:54.944239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:54.944584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:54.944966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:54.955874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:54.957653 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:54.973501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1205/2411] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:06:54.984013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:54.986194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:54.996049 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1207/2412] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:55.031165 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:55.032564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:55.051313 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b186fa-fb10-4bca-9387-c915db448a41 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:55.055122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:55.055722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:55.055999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:55.056320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:55.115291 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:55.116646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:55.125808 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1206/2413] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:55.291495 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:55.293362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:55.419861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc83450-bdb8-4a9b-bd1f-72764dcb01e8 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:55.429577 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c5204-8251-494b-9ef1-45d8e025c6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:55.430213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5204-8251-494b-9ef1-45d8e025c6ea service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:55.430491 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5204-8251-494b-9ef1-45d8e025c6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:55.430759 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5204-8251-494b-9ef1-45d8e025c6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:55.433052 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b57c5204-8251-494b-9ef1-45d8e025c6ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:55.491530 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:55.523639 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c5204-8251-494b-9ef1-45d8e025c6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:55.525282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c5204-8251-494b-9ef1-45d8e025c6ea service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:55.539651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1208/2414] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:56.998274 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:56.999801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:57.022977 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75be216-fd2e-4771-86f4-3b5cc1fa7b73 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:57.035876 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:57.036565 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:57.037013 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:57.037443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] PATH_INFO: `/v3/users/2bf0448f846547f08a7634fbe5bfebe6` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:57.039112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf0448f846547f08a7634fbe5bfebe6)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:57.043002 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:57.101062 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:57.107188 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf0448f846547f08a7634fbe5bfebe6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.120894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf0448f846547f08a7634fbe5bfebe6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.121721 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf0448f846547f08a7634fbe5bfebe6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.128926 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf0448f846547f08a7634fbe5bfebe6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.129561 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf0448f846547f08a7634fbe5bfebe6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.142423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1207/2415] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:56 2022] DELETE /identity/v3/users/2bf0448f846547f08a7634fbe5bfebe6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:57.147197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3df44-ceae-48b3-9449-70707cf72058 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:57.147731 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3df44-ceae-48b3-9449-70707cf72058 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:57.147731 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3df44-ceae-48b3-9449-70707cf72058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:57.166793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6bd3df44-ceae-48b3-9449-70707cf72058 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:57.167986 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6bd3df44-ceae-48b3-9449-70707cf72058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:57.229629 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1209/2416] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:57.240134 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:57.241630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:57.301122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0174-cacc-4c51-a7f9-097c01a8e975 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:57.305833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bb3ef-90d6-4292-894b-4d0d251f8772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:57.306508 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb3ef-90d6-4292-894b-4d0d251f8772 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:57.306851 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb3ef-90d6-4292-894b-4d0d251f8772 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:57.307184 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bb3ef-90d6-4292-894b-4d0d251f8772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:57.317398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bb3ef-90d6-4292-894b-4d0d251f8772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:57.319544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bb3ef-90d6-4292-894b-4d0d251f8772 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:57.329237 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1208/2417] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:57.732689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3df44-ceae-48b3-9449-70707cf72058 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:57.739883 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6bd3df44-ceae-48b3-9449-70707cf72058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:57.756571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3df44-ceae-48b3-9449-70707cf72058 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:57.771275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:57.772034 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:57.772849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:57.772849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] PATH_INFO: `/v3/projects/0ba86ed36e2e465280a066f71204d823` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:57.774243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba86ed36e2e465280a066f71204d823)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:57.776287 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:57.840340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba86ed36e2e465280a066f71204d823', 'request_id': 'req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.846633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba86ed36e2e465280a066f71204d823', 'request_id': 'req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.854588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba86ed36e2e465280a066f71204d823', 'request_id': 'req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.868961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] The token cache is being invalidate because project 0ba86ed36e2e465280a066f71204d823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:57.869301 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.870640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:57.873134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1210/2418] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:57 2022] DELETE /identity/v3/projects/0ba86ed36e2e465280a066f71204d823 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:57.876140 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bb3ef-90d6-4292-894b-4d0d251f8772 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:57.886817 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bb3ef-90d6-4292-894b-4d0d251f8772 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:57.951311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:57.951959 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:57.952295 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:57.952631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] PATH_INFO: `/v3/users/d26c70188cea4217ae69b8d1fe3d2d57` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:57.953853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26c70188cea4217ae69b8d1fe3d2d57)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:57.955887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:58.017972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26c70188cea4217ae69b8d1fe3d2d57'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:58.031448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:58.034808 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26c70188cea4217ae69b8d1fe3d2d57'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:58.036251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26c70188cea4217ae69b8d1fe3d2d57'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:58.047074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26c70188cea4217ae69b8d1fe3d2d57'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:58.048040 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26c70188cea4217ae69b8d1fe3d2d57'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:58.063364 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1209/2419] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:57 2022] DELETE /identity/v3/users/d26c70188cea4217ae69b8d1fe3d2d57 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:58.801098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:58.803240 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:58.835886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca150c-d39a-4a8f-bde4-8ef1651c4d41 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:58.970584 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:58.971419 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:58.971745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:58.972201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] PATH_INFO: `/v3/projects/031d097d79a7489b897bef1e3c541e17` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:58.975694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=031d097d79a7489b897bef1e3c541e17)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:58.978321 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.000750 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:59.008104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:59.009750 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:59.029563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb1d79-ecfb-4ebb-912c-d9cdaebf406f admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:59.045543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:59.046207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.046484 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.046825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] PATH_INFO: `/v3/users/0497df6a213f4ccbbb9d1169d93fe6d5` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.050129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0497df6a213f4ccbbb9d1169d93fe6d5)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:59.052791 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.107188 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031d097d79a7489b897bef1e3c541e17', 'request_id': 'req-9911a6b1-dd75-4efb-be1e-8b75610ab21a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.115405 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031d097d79a7489b897bef1e3c541e17', 'request_id': 'req-9911a6b1-dd75-4efb-be1e-8b75610ab21a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.128566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031d097d79a7489b897bef1e3c541e17', 'request_id': 'req-9911a6b1-dd75-4efb-be1e-8b75610ab21a'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.149631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0497df6a213f4ccbbb9d1169d93fe6d5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.152218 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] The token cache is being invalidate because project 031d097d79a7489b897bef1e3c541e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:59.152698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.153571 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-9911a6b1-dd75-4efb-be1e-8b75610ab21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.155340 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1211/2420] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:58 2022] DELETE /identity/v3/projects/031d097d79a7489b897bef1e3c541e17 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:59.161823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4cb0-e755-49b2-8c9b-957b9fc08aaf None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.162101 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4cb0-e755-49b2-8c9b-957b9fc08aaf None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.162560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4cb0-e755-49b2-8c9b-957b9fc08aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.183476 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-568e4cb0-e755-49b2-8c9b-957b9fc08aaf None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:59.183900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0497df6a213f4ccbbb9d1169d93fe6d5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.184826 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0497df6a213f4ccbbb9d1169d93fe6d5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.185348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-568e4cb0-e755-49b2-8c9b-957b9fc08aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:59.198352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0497df6a213f4ccbbb9d1169d93fe6d5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.200213 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4d3b8bfe-b9d2-44bf-ae63-ba7b551503f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0497df6a213f4ccbbb9d1169d93fe6d5'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:59.219843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1210/2421] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:59 2022] DELETE /identity/v3/users/0497df6a213f4ccbbb9d1169d93fe6d5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:06:59.225615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114501-3fef-4b76-a58c-11e37e20e078 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.226859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114501-3fef-4b76-a58c-11e37e20e078 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.227156 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114501-3fef-4b76-a58c-11e37e20e078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.252434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-0e114501-3fef-4b76-a58c-11e37e20e078 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:59.253880 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0e114501-3fef-4b76-a58c-11e37e20e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:59.256615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1212/2422] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:59.264193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938358-19d1-453a-ab0e-004e6220a0f8 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.267091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938358-19d1-453a-ab0e-004e6220a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.267384 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29938358-19d1-453a-ab0e-004e6220a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.301250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-29938358-19d1-453a-ab0e-004e6220a0f8 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:59.303093 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-29938358-19d1-453a-ab0e-004e6220a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:59.345759 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1211/2423] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:59.356096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e114501-3fef-4b76-a58c-11e37e20e078 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:59.358432 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-0e114501-3fef-4b76-a58c-11e37e20e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:59.392026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1213/2424] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:59.396513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938358-19d1-453a-ab0e-004e6220a0f8 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:59.407993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29938358-19d1-453a-ab0e-004e6220a0f8 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:59.417176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:59.418242 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.418525 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.418921 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.420234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:59.420717 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:59.423297 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.448670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1214/2425] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:06:59.450451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e114501-3fef-4b76-a58c-11e37e20e078 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:59.452748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:59.455347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42d9bc-0c19-4de7-9da6-cddbc999e22d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:59.456033 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42d9bc-0c19-4de7-9da6-cddbc999e22d service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.456386 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42d9bc-0c19-4de7-9da6-cddbc999e22d service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.456941 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42d9bc-0c19-4de7-9da6-cddbc999e22d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.463524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be9ed5-65db-4f6b-9c38-e73a67d79e4d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:59.465944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:59.470083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c3325-38de-4b49-939c-8da69dcfc727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:59.470606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42d9bc-0c19-4de7-9da6-cddbc999e22d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:59.470748 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c3325-38de-4b49-939c-8da69dcfc727 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.470997 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c3325-38de-4b49-939c-8da69dcfc727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.471302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c3325-38de-4b49-939c-8da69dcfc727 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.472134 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c3325-38de-4b49-939c-8da69dcfc727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:59.476766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c3325-38de-4b49-939c-8da69dcfc727 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.480097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42d9bc-0c19-4de7-9da6-cddbc999e22d service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.506579 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:59.508999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1212/2426] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:59.528666 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1215/2427] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:59 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:06:59.529996 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42d9bc-0c19-4de7-9da6-cddbc999e22d service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:59.546422 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42d9bc-0c19-4de7-9da6-cddbc999e22d service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:59.631855 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a604fe-dad9-43da-965f-d2c05aaef72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:59.632901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a604fe-dad9-43da-965f-d2c05aaef72b admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.633230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a604fe-dad9-43da-965f-d2c05aaef72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.633537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a604fe-dad9-43da-965f-d2c05aaef72b admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.634249 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a604fe-dad9-43da-965f-d2c05aaef72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:59.636328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a604fe-dad9-43da-965f-d2c05aaef72b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.662585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1213/2428] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:59 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:59.666614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c3325-38de-4b49-939c-8da69dcfc727 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:59.677494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c3325-38de-4b49-939c-8da69dcfc727 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:59.682455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98718-f01f-4358-9979-a4a6cc52b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:59.683083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98718-f01f-4358-9979-a4a6cc52b213 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.683371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98718-f01f-4358-9979-a4a6cc52b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.683625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98718-f01f-4358-9979-a4a6cc52b213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.684278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98718-f01f-4358-9979-a4a6cc52b213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:59.685968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98718-f01f-4358-9979-a4a6cc52b213 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.698344 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1216/2429] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:59.702224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a604fe-dad9-43da-965f-d2c05aaef72b admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:59.713967 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a604fe-dad9-43da-965f-d2c05aaef72b admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:59.719542 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff227f5-1888-43bd-acbd-48d1ed0ee84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:59.720173 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff227f5-1888-43bd-acbd-48d1ed0ee84b admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.720453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff227f5-1888-43bd-acbd-48d1ed0ee84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.720728 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff227f5-1888-43bd-acbd-48d1ed0ee84b admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.721406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff227f5-1888-43bd-acbd-48d1ed0ee84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:59.723045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff227f5-1888-43bd-acbd-48d1ed0ee84b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.734798 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1214/2430] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:59.738855 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98718-f01f-4358-9979-a4a6cc52b213 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:59.749632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98718-f01f-4358-9979-a4a6cc52b213 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:59.755514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35f8ca-9ec2-4f0d-a3b5-28aa64ef64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:59.756457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f8ca-9ec2-4f0d-a3b5-28aa64ef64a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.757018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f8ca-9ec2-4f0d-a3b5-28aa64ef64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.757371 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35f8ca-9ec2-4f0d-a3b5-28aa64ef64a0 admin admin] PATH_INFO: `/v3/projects/248aa2aa138b4e9d998181beabdf181a/users/0ced53e1cec441e69414c6b1f61d6454/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.775031 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35f8ca-9ec2-4f0d-a3b5-28aa64ef64a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248aa2aa138b4e9d998181beabdf181a, user_id=0ced53e1cec441e69414c6b1f61d6454, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:59.778066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35f8ca-9ec2-4f0d-a3b5-28aa64ef64a0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:59.792885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1217/2431] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:59 2022] PUT /identity/v3/projects/248aa2aa138b4e9d998181beabdf181a/users/0ced53e1cec441e69414c6b1f61d6454/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:59.804859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407af7-0af2-417f-9c54-615478917f69 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:59.805146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407af7-0af2-417f-9c54-615478917f69 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:59.805442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407af7-0af2-417f-9c54-615478917f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:59.838053 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ff407af7-0af2-417f-9c54-615478917f69 None None] MFA Rules not processed for user `0ced53e1cec441e69414c6b1f61d6454`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:59.839306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ff407af7-0af2-417f-9c54-615478917f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:59.920780 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1215/2432] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:59.925014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35f8ca-9ec2-4f0d-a3b5-28aa64ef64a0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.042288 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35f8ca-9ec2-4f0d-a3b5-28aa64ef64a0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.049292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be87b5b-8922-44ad-ac5b-8c46e486bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.050299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87b5b-8922-44ad-ac5b-8c46e486bd2e admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.050681 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87b5b-8922-44ad-ac5b-8c46e486bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.051482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87b5b-8922-44ad-ac5b-8c46e486bd2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.052765 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be87b5b-8922-44ad-ac5b-8c46e486bd2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:00.055329 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be87b5b-8922-44ad-ac5b-8c46e486bd2e admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:00.088723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1218/2433] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:59 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:00.093517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff407af7-0af2-417f-9c54-615478917f69 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.118116 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff407af7-0af2-417f-9c54-615478917f69 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.230674 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e7144-3fef-4601-9b43-bc79f2c34477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.231347 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7144-3fef-4601-9b43-bc79f2c34477 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.231629 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7144-3fef-4601-9b43-bc79f2c34477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.231901 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7144-3fef-4601-9b43-bc79f2c34477 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.232543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e7144-3fef-4601-9b43-bc79f2c34477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:00.235993 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e7144-3fef-4601-9b43-bc79f2c34477 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:00.249419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:00.263656 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1216/2434] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:07:00 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:00.267565 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be87b5b-8922-44ad-ac5b-8c46e486bd2e admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.286217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be87b5b-8922-44ad-ac5b-8c46e486bd2e admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.300872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab9ccd-7883-4cac-808a-41fc60cdfd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.301504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab9ccd-7883-4cac-808a-41fc60cdfd45 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.302356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab9ccd-7883-4cac-808a-41fc60cdfd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.302633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab9ccd-7883-4cac-808a-41fc60cdfd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.303282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab9ccd-7883-4cac-808a-41fc60cdfd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:00.305035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab9ccd-7883-4cac-808a-41fc60cdfd45 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:00.327846 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e7144-3fef-4601-9b43-bc79f2c34477 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.328514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1219/2435] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:00.343578 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e7144-3fef-4601-9b43-bc79f2c34477 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.356352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a808e03-bb44-4d1c-9ebc-5f4b8b8466cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.356899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a808e03-bb44-4d1c-9ebc-5f4b8b8466cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.357216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a808e03-bb44-4d1c-9ebc-5f4b8b8466cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.357448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a808e03-bb44-4d1c-9ebc-5f4b8b8466cb admin admin] PATH_INFO: `/v3/projects/46858da0442943b491be2162819bb2ce/users/b419607d882e474d8cec1084acc40708/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.380778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a808e03-bb44-4d1c-9ebc-5f4b8b8466cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=46858da0442943b491be2162819bb2ce, user_id=b419607d882e474d8cec1084acc40708, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:00.384216 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a808e03-bb44-4d1c-9ebc-5f4b8b8466cb admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:00.424255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1217/2436] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:07:00 2022] PUT /identity/v3/projects/46858da0442943b491be2162819bb2ce/users/b419607d882e474d8cec1084acc40708/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:07:00.427606 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab9ccd-7883-4cac-808a-41fc60cdfd45 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.444170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab9ccd-7883-4cac-808a-41fc60cdfd45 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.525797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80bc8-a460-4af1-862e-3f25577a6cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.526316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80bc8-a460-4af1-862e-3f25577a6cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.526593 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80bc8-a460-4af1-862e-3f25577a6cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.526944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80bc8-a460-4af1-862e-3f25577a6cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.527838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f80bc8-a460-4af1-862e-3f25577a6cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:00.529456 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f80bc8-a460-4af1-862e-3f25577a6cc3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:00.544796 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1220/2437] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:00.548942 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a808e03-bb44-4d1c-9ebc-5f4b8b8466cb admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.562498 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a808e03-bb44-4d1c-9ebc-5f4b8b8466cb admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.568736 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.569701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.569701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.569967 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] PATH_INFO: `/v3/projects/46858da0442943b491be2162819bb2ce/users/b419607d882e474d8cec1084acc40708/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.571972 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46858da0442943b491be2162819bb2ce, user_id=b419607d882e474d8cec1084acc40708, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:00.575061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:00.588162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1218/2438] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:07:00 2022] PUT /identity/v3/projects/46858da0442943b491be2162819bb2ce/users/b419607d882e474d8cec1084acc40708/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:00.599647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006763d5-a8e9-4f4e-ad49-ed2bf16d980f None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.599924 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006763d5-a8e9-4f4e-ad49-ed2bf16d980f None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.600220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006763d5-a8e9-4f4e-ad49-ed2bf16d980f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.649028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.651180 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:00.662238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-006763d5-a8e9-4f4e-ad49-ed2bf16d980f None None] MFA Rules not processed for user `b419607d882e474d8cec1084acc40708`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:00.664885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-006763d5-a8e9-4f4e-ad49-ed2bf16d980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:00.708597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:00.762615 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074be238-e6e5-4c97-a4b7-f2ce16eb4e81 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.772147 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.773337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.777148 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1221/2439] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:00.781754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.781754 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] PATH_INFO: `/v3/projects/f3d1019d3400428d9e3ea15b6b602ba5` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.785576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d1019d3400428d9e3ea15b6b602ba5)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:00.788623 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:00.792496 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006763d5-a8e9-4f4e-ad49-ed2bf16d980f None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.794316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-006763d5-a8e9-4f4e-ad49-ed2bf16d980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:00.853284 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d1019d3400428d9e3ea15b6b602ba5', 'request_id': 'req-468dd106-52cb-4c94-86f2-4c697e3c28cb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:00.859732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006763d5-a8e9-4f4e-ad49-ed2bf16d980f None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.860185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d1019d3400428d9e3ea15b6b602ba5', 'request_id': 'req-468dd106-52cb-4c94-86f2-4c697e3c28cb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:00.866878 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d1019d3400428d9e3ea15b6b602ba5', 'request_id': 'req-468dd106-52cb-4c94-86f2-4c697e3c28cb'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:00.880968 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] The token cache is being invalidate because project f3d1019d3400428d9e3ea15b6b602ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:00.881731 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:00.883185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:00.885466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1219/2440] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:00 2022] DELETE /identity/v3/projects/f3d1019d3400428d9e3ea15b6b602ba5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:00.890006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:00.891911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:00.919139 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.920168 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.920449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.920721 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.922914 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:00.947263 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:00.969321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dd106-52cb-4c94-86f2-4c697e3c28cb admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:00.975304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:00.976136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:00.976474 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:00.976812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] PATH_INFO: `/v3/users/169f0c2c896b422cbeb2e1fb45df6ab0` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:00.978059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169f0c2c896b422cbeb2e1fb45df6ab0)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:00.979955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:01.014170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:01.015457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:01.028237 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1222/2441] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:07:01.038039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169f0c2c896b422cbeb2e1fb45df6ab0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.057112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169f0c2c896b422cbeb2e1fb45df6ab0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.061431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169f0c2c896b422cbeb2e1fb45df6ab0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.079127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169f0c2c896b422cbeb2e1fb45df6ab0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.080178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169f0c2c896b422cbeb2e1fb45df6ab0'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.099462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1220/2442] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:00 2022] DELETE /identity/v3/users/169f0c2c896b422cbeb2e1fb45df6ab0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:01.146189 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:01.148234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:01.165650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9034a-c6a4-42d6-8038-cdb5ce4b24b5 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:01.212107 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:01.240833 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:01.241555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:01.241916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:01.242250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:01.244110 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:01.313079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:01.314755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:01.325186 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1223/2443] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:01.516849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:01.518371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:01.592332 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:01.593916 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:01.659198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009b8a-b77b-457e-9f4c-4fc629ddada1 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:01.664293 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:01.666114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:01.666398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:01.666671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] PATH_INFO: `/v3/projects/0e130fe3aa9d40aaa4bae4771a46e3fa` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:01.668098 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e130fe3aa9d40aaa4bae4771a46e3fa)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:01.670451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:01.739105 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11f4d-946e-477d-b020-3bf382d7fe72 service cinder] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:01.768444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e130fe3aa9d40aaa4bae4771a46e3fa', 'request_id': 'req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.776874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e130fe3aa9d40aaa4bae4771a46e3fa', 'request_id': 'req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.784849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e130fe3aa9d40aaa4bae4771a46e3fa', 'request_id': 'req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.789737 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:01.808146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] The token cache is being invalidate because project 0e130fe3aa9d40aaa4bae4771a46e3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:01.809705 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.810517 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-cbf9d75a-122a-4ee9-8ac2-d33907ab780f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:01.812321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1221/2444] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:01 2022] DELETE /identity/v3/projects/0e130fe3aa9d40aaa4bae4771a46e3fa => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:01.818351 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc65f7-3201-4d47-9b39-2d91557eba76 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:01.818841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc65f7-3201-4d47-9b39-2d91557eba76 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:01.818948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc65f7-3201-4d47-9b39-2d91557eba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:01.837689 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:01.838568 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:01.838944 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:01.839318 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:01.841406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-94cc65f7-3201-4d47-9b39-2d91557eba76 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:01.841771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:01.842740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-94cc65f7-3201-4d47-9b39-2d91557eba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:01.899506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=100 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:01.916904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1222/2445] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:01.917097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:01.918893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:01.924710 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387feea-3587-4039-8ed1-c5312a3acb56 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:01.925059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387feea-3587-4039-8ed1-c5312a3acb56 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:01.925515 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387feea-3587-4039-8ed1-c5312a3acb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:01.930566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1224/2446] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:07:01.946352 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-5387feea-3587-4039-8ed1-c5312a3acb56 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:01.947684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-5387feea-3587-4039-8ed1-c5312a3acb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:01.956166 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1223/2447] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:01.960319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:01.975450 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea769dc-e795-4475-b187-ecec29570134 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:01.981061 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:01.981844 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:01.982121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:01.982392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:01.983224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:07:01.983540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:01.985694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:02.000789 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1225/2448] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:07:02.006348 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387feea-3587-4039-8ed1-c5312a3acb56 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:02.017657 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387feea-3587-4039-8ed1-c5312a3acb56 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:02.023585 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245414a5-2818-4349-8522-a132310d8b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:02.024454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245414a5-2818-4349-8522-a132310d8b79 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:02.024813 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245414a5-2818-4349-8522-a132310d8b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:02.025128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245414a5-2818-4349-8522-a132310d8b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:02.026502 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245414a5-2818-4349-8522-a132310d8b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:02.029084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245414a5-2818-4349-8522-a132310d8b79 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:02.065668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1224/2449] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:07:02 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:07:02.066838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:02.078338 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b07e03-d36e-4a94-9ba2-ae6f0fb37b88 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:02.185056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126f66b-d55e-4533-9d6b-4fcec4dcdb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:02.185741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f66b-d55e-4533-9d6b-4fcec4dcdb0f admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:02.186013 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f66b-d55e-4533-9d6b-4fcec4dcdb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:02.186861 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f66b-d55e-4533-9d6b-4fcec4dcdb0f admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:02.191075 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126f66b-d55e-4533-9d6b-4fcec4dcdb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:02.193627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126f66b-d55e-4533-9d6b-4fcec4dcdb0f admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:02.231003 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1226/2450] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:07:02 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:02.234570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245414a5-2818-4349-8522-a132310d8b79 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:02.251831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245414a5-2818-4349-8522-a132310d8b79 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:02.257242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1b031-6acc-41fb-af28-09c1471cda19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:02.257927 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b031-6acc-41fb-af28-09c1471cda19 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:02.258862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b031-6acc-41fb-af28-09c1471cda19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:02.259318 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b031-6acc-41fb-af28-09c1471cda19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:02.260514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1b031-6acc-41fb-af28-09c1471cda19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:02.262320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1b031-6acc-41fb-af28-09c1471cda19 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:02.274080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1225/2451] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:02.278057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126f66b-d55e-4533-9d6b-4fcec4dcdb0f admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:02.289356 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126f66b-d55e-4533-9d6b-4fcec4dcdb0f admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:02.294133 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2ac5-c17d-474a-913d-00e92e9b1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:02.294911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2ac5-c17d-474a-913d-00e92e9b1b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:02.295260 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2ac5-c17d-474a-913d-00e92e9b1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:02.295620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2ac5-c17d-474a-913d-00e92e9b1b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:02.296966 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d2ac5-c17d-474a-913d-00e92e9b1b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:02.298248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d2ac5-c17d-474a-913d-00e92e9b1b80 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:02.309556 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1227/2452] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:02.313427 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1b031-6acc-41fb-af28-09c1471cda19 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:02.323694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1b031-6acc-41fb-af28-09c1471cda19 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:02.328955 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:02.329650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:02.330406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:02.330406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] PATH_INFO: `/v3/projects/120281a4208b41979b89ded34ce9e0cd/users/26cbf8da50354e85b81df742737ec8a6/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:02.347069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120281a4208b41979b89ded34ce9e0cd, user_id=26cbf8da50354e85b81df742737ec8a6, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:02.351309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:02.366874 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1226/2453] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:07:02 2022] PUT /identity/v3/projects/120281a4208b41979b89ded34ce9e0cd/users/26cbf8da50354e85b81df742737ec8a6/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:02.378234 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610102-fe21-40bf-aa4a-6a7180c21318 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:02.378512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610102-fe21-40bf-aa4a-6a7180c21318 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:02.378784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610102-fe21-40bf-aa4a-6a7180c21318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:02.411772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d7610102-fe21-40bf-aa4a-6a7180c21318 None None] MFA Rules not processed for user `26cbf8da50354e85b81df742737ec8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:02.413024 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d7610102-fe21-40bf-aa4a-6a7180c21318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:02.514401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1228/2454] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:07:02.527655 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:02.529740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:02.606185 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b138731-b12c-460d-a38f-ae31e571df36 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:02.609697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e3c46-e18d-4a19-be98-fe557ac53b17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:02.610700 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3c46-e18d-4a19-be98-fe557ac53b17 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:02.611073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3c46-e18d-4a19-be98-fe557ac53b17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:02.611434 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e3c46-e18d-4a19-be98-fe557ac53b17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:02.621604 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e3c46-e18d-4a19-be98-fe557ac53b17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:02.623158 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e3c46-e18d-4a19-be98-fe557ac53b17 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:02.636070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1227/2455] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:06.406285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7610102-fe21-40bf-aa4a-6a7180c21318 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:06.407891 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d7610102-fe21-40bf-aa4a-6a7180c21318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:06.464007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:06.483696 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7610102-fe21-40bf-aa4a-6a7180c21318 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:06.489026 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:06.490232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:06.490506 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:06.490777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] PATH_INFO: `/v3/users/accfa9fc356a4ccca7332118e8b9c421` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:06.491900 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=accfa9fc356a4ccca7332118e8b9c421)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:06.494002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:06.543686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accfa9fc356a4ccca7332118e8b9c421'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.556279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accfa9fc356a4ccca7332118e8b9c421'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.557033 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accfa9fc356a4ccca7332118e8b9c421'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.564985 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accfa9fc356a4ccca7332118e8b9c421'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.565794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accfa9fc356a4ccca7332118e8b9c421'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.578569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1229/2456] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:06 2022] DELETE /identity/v3/users/accfa9fc356a4ccca7332118e8b9c421 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:06.754095 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e3c46-e18d-4a19-be98-fe557ac53b17 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:06.767486 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e3c46-e18d-4a19-be98-fe557ac53b17 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:06.805964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:06.832525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:06.833845 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:06.834237 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:06.834518 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] PATH_INFO: `/v3/projects/97fa795966724ea89be8ac20675b589b` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:06.835724 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fa795966724ea89be8ac20675b589b)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:06.837652 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:06.888101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fa795966724ea89be8ac20675b589b', 'request_id': 'req-574fb1b4-8168-43a7-ad4c-a030d53aeb74'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.894104 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fa795966724ea89be8ac20675b589b', 'request_id': 'req-574fb1b4-8168-43a7-ad4c-a030d53aeb74'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.903305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fa795966724ea89be8ac20675b589b', 'request_id': 'req-574fb1b4-8168-43a7-ad4c-a030d53aeb74'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.917819 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] The token cache is being invalidate because project 97fa795966724ea89be8ac20675b589b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:06.918148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.918925 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:06.922858 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1228/2457] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:06 2022] DELETE /identity/v3/projects/97fa795966724ea89be8ac20675b589b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:06.927561 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:06.930062 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:06.947380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde357b-849c-47f0-bc0c-5c45498ee2d0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:07.017659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:07.018295 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:07.018567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:07.018831 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] PATH_INFO: `/v3/users/f59de23429ef4bbd94fd2c88456a0689` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:07.019941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59de23429ef4bbd94fd2c88456a0689)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:07.022457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:07.069791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59de23429ef4bbd94fd2c88456a0689'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.080528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:07.082114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59de23429ef4bbd94fd2c88456a0689'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.083523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59de23429ef4bbd94fd2c88456a0689'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.092044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59de23429ef4bbd94fd2c88456a0689'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.092757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59de23429ef4bbd94fd2c88456a0689'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.106091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1230/2458] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:06 2022] DELETE /identity/v3/users/f59de23429ef4bbd94fd2c88456a0689 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:07.277003 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:07.278453 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:07.291229 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fb1b4-8168-43a7-ad4c-a030d53aeb74 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:07.348922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:07.349577 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:07.349860 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:07.350131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] PATH_INFO: `/v3/projects/f9c17763aab14c4cbdaef31e929da0a4` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:07.351261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c17763aab14c4cbdaef31e929da0a4)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:07.353164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:07.398697 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c17763aab14c4cbdaef31e929da0a4', 'request_id': 'req-aa26367c-2205-43c6-a64a-e4420c012c35'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.404308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c17763aab14c4cbdaef31e929da0a4', 'request_id': 'req-aa26367c-2205-43c6-a64a-e4420c012c35'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.411156 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c17763aab14c4cbdaef31e929da0a4', 'request_id': 'req-aa26367c-2205-43c6-a64a-e4420c012c35'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.415112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:07.426961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] The token cache is being invalidate because project f9c17763aab14c4cbdaef31e929da0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:07.427323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.428322 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-aa26367c-2205-43c6-a64a-e4420c012c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:07.429911 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1229/2459] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:07 2022] DELETE /identity/v3/projects/f9c17763aab14c4cbdaef31e929da0a4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:08.265543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:08.267543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:08.284558 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983b9a4-6366-4704-8dc2-62cf06ea8acc admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:08.362362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:08.362919 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:08.363196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:08.363466 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] PATH_INFO: `/v3/users/0ced53e1cec441e69414c6b1f61d6454` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:08.364635 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ced53e1cec441e69414c6b1f61d6454)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:08.366615 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:08.425695 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ced53e1cec441e69414c6b1f61d6454'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:08.440694 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ced53e1cec441e69414c6b1f61d6454'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:08.441751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ced53e1cec441e69414c6b1f61d6454'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:08.452157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ced53e1cec441e69414c6b1f61d6454'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:08.452994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ced53e1cec441e69414c6b1f61d6454'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:08.469120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1231/2460] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:08 2022] DELETE /identity/v3/users/0ced53e1cec441e69414c6b1f61d6454 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:08.474306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1e3ec-1c2f-405b-a553-fd349b0cf349 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:08.474760 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1e3ec-1c2f-405b-a553-fd349b0cf349 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:08.474871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1e3ec-1c2f-405b-a553-fd349b0cf349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:08.495452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-b1f1e3ec-1c2f-405b-a553-fd349b0cf349 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:08.501224 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b1f1e3ec-1c2f-405b-a553-fd349b0cf349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:08.564397 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1230/2461] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:08.571053 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:08.572472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:08.630329 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71d8d-80dd-4e26-82d3-0a53124dab40 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:08.633849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de102a5-0c23-4f95-8f7b-3b2a9e5386b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:08.634449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de102a5-0c23-4f95-8f7b-3b2a9e5386b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:08.634724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de102a5-0c23-4f95-8f7b-3b2a9e5386b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:08.634990 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de102a5-0c23-4f95-8f7b-3b2a9e5386b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:08.644724 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de102a5-0c23-4f95-8f7b-3b2a9e5386b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:08.646040 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de102a5-0c23-4f95-8f7b-3b2a9e5386b6 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:08.655768 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1232/2462] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:08.935680 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1e3ec-1c2f-405b-a553-fd349b0cf349 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:08.937189 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b1f1e3ec-1c2f-405b-a553-fd349b0cf349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:08.950346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1e3ec-1c2f-405b-a553-fd349b0cf349 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:08.955018 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:08.955716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:08.955998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:08.956266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] PATH_INFO: `/v3/projects/248aa2aa138b4e9d998181beabdf181a` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:08.957580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248aa2aa138b4e9d998181beabdf181a)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:08.960346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:09.011317 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248aa2aa138b4e9d998181beabdf181a', 'request_id': 'req-ae83db7c-e9ce-466f-9b70-bb79c150da33'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.016954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248aa2aa138b4e9d998181beabdf181a', 'request_id': 'req-ae83db7c-e9ce-466f-9b70-bb79c150da33'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.023233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248aa2aa138b4e9d998181beabdf181a', 'request_id': 'req-ae83db7c-e9ce-466f-9b70-bb79c150da33'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.035966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] The token cache is being invalidate because project 248aa2aa138b4e9d998181beabdf181a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:09.036258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.036887 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.038420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1231/2463] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:08 2022] DELETE /identity/v3/projects/248aa2aa138b4e9d998181beabdf181a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:07:09.042513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de102a5-0c23-4f95-8f7b-3b2a9e5386b6 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:09.047314 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:09.053203 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de102a5-0c23-4f95-8f7b-3b2a9e5386b6 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:09.110622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:09.111273 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:09.111547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:09.111810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] PATH_INFO: `/v3/users/b419607d882e474d8cec1084acc40708` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:09.112908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b419607d882e474d8cec1084acc40708)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:09.115438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:09.160030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b419607d882e474d8cec1084acc40708'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.171459 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b419607d882e474d8cec1084acc40708'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.172108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b419607d882e474d8cec1084acc40708'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.179734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b419607d882e474d8cec1084acc40708'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.180362 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5c0eeee9-e055-46e2-b051-affab313337c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b419607d882e474d8cec1084acc40708'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.192754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1233/2464] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:09 2022] DELETE /identity/v3/users/b419607d882e474d8cec1084acc40708 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:09.467795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:09.469225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:09.482991 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83db7c-e9ce-466f-9b70-bb79c150da33 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:09.545122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:09.545822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:09.546101 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:09.546396 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] PATH_INFO: `/v3/projects/46858da0442943b491be2162819bb2ce` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:09.547740 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=46858da0442943b491be2162819bb2ce)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:09.549701 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:09.572250 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:09.596076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46858da0442943b491be2162819bb2ce', 'request_id': 'req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.602468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46858da0442943b491be2162819bb2ce', 'request_id': 'req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.609208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46858da0442943b491be2162819bb2ce', 'request_id': 'req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.623276 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] The token cache is being invalidate because project 46858da0442943b491be2162819bb2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:09.623570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.624230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-2ecfc9e2-7b1d-4a46-9efc-50fbb3da4f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:09.626136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1232/2465] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:09 2022] DELETE /identity/v3/projects/46858da0442943b491be2162819bb2ce => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:09.630811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7d193-6a13-4ab2-9736-f62b17f51f79 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:09.631300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7d193-6a13-4ab2-9736-f62b17f51f79 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:09.631400 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7d193-6a13-4ab2-9736-f62b17f51f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:09.652275 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-b3d7d193-6a13-4ab2-9736-f62b17f51f79 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:09.653607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-b3d7d193-6a13-4ab2-9736-f62b17f51f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:09.726763 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1234/2466] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:07:09.734626 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddc372-6c64-45db-a37a-6494a647f038 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:09.735161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddc372-6c64-45db-a37a-6494a647f038 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:09.735442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddc372-6c64-45db-a37a-6494a647f038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:09.756715 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-92ddc372-6c64-45db-a37a-6494a647f038 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:09.758026 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-92ddc372-6c64-45db-a37a-6494a647f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:09.765951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1233/2467] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:09.770643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7d193-6a13-4ab2-9736-f62b17f51f79 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:09.780197 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7d193-6a13-4ab2-9736-f62b17f51f79 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:09.784852 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:09.785449 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:09.785817 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:09.786698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:09.787261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:07:09.787563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:09.789250 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:09.804370 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1235/2468] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:07:09.805552 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddc372-6c64-45db-a37a-6494a647f038 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:09.815277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddc372-6c64-45db-a37a-6494a647f038 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:09.820402 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0547-1192-48f4-ba2f-f305d841f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:09.820605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0547-1192-48f4-ba2f-f305d841f70a admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:09.820871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0547-1192-48f4-ba2f-f305d841f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:09.821142 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0547-1192-48f4-ba2f-f305d841f70a admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:09.821956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b0547-1192-48f4-ba2f-f305d841f70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:09.823899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b0547-1192-48f4-ba2f-f305d841f70a admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:09.857200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1234/2469] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:07:09 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:09.861573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:09.873547 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921a41-e945-4dc5-b88b-f879a8845eb2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:09.880524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:09.943254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1a690-6ba7-444f-9ed0-47cadc9485a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:09.943794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1a690-6ba7-444f-9ed0-47cadc9485a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:09.944074 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1a690-6ba7-444f-9ed0-47cadc9485a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:09.944346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1a690-6ba7-444f-9ed0-47cadc9485a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:09.944974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1a690-6ba7-444f-9ed0-47cadc9485a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:09.946945 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1a690-6ba7-444f-9ed0-47cadc9485a1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:09.972807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1236/2470] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:07:09 2022] POST /identity/v3/users => generated 280 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:09.974751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0547-1192-48f4-ba2f-f305d841f70a admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:09.990129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0547-1192-48f4-ba2f-f305d841f70a admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:09.994893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ae91-c1b9-47a3-bdfe-b402a9a9e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:09.995595 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ae91-c1b9-47a3-bdfe-b402a9a9e472 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:09.995872 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ae91-c1b9-47a3-bdfe-b402a9a9e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:09.996145 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ae91-c1b9-47a3-bdfe-b402a9a9e472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:09.996794 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244ae91-c1b9-47a3-bdfe-b402a9a9e472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:09.998445 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244ae91-c1b9-47a3-bdfe-b402a9a9e472 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:10.011640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1235/2471] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:10.012988 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1a690-6ba7-444f-9ed0-47cadc9485a1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:10.024552 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1a690-6ba7-444f-9ed0-47cadc9485a1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:10.029221 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22521bce-ec58-4ce3-97a1-6fb065999310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:10.029847 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521bce-ec58-4ce3-97a1-6fb065999310 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.030149 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521bce-ec58-4ce3-97a1-6fb065999310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.030416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521bce-ec58-4ce3-97a1-6fb065999310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.031047 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22521bce-ec58-4ce3-97a1-6fb065999310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:10.032621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22521bce-ec58-4ce3-97a1-6fb065999310 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:10.045576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1237/2472] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:10.048239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ae91-c1b9-47a3-bdfe-b402a9a9e472 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:10.059443 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ae91-c1b9-47a3-bdfe-b402a9a9e472 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:10.065308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:10.066015 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.066296 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.066573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] PATH_INFO: `/v3/projects/cde15c9a4573452094625a1bc31e0717/users/1f64264d461d47719123ac3fb2f78aac/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.082244 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde15c9a4573452094625a1bc31e0717, user_id=1f64264d461d47719123ac3fb2f78aac, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:10.084938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:10.105133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1236/2473] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:07:10 2022] PUT /identity/v3/projects/cde15c9a4573452094625a1bc31e0717/users/1f64264d461d47719123ac3fb2f78aac/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:07:10.117583 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a398b1a-a6a9-4f00-9576-a3b6a0bde3fd None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.117951 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a398b1a-a6a9-4f00-9576-a3b6a0bde3fd None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.118243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a398b1a-a6a9-4f00-9576-a3b6a0bde3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.146082 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0a398b1a-a6a9-4f00-9576-a3b6a0bde3fd None None] MFA Rules not processed for user `1f64264d461d47719123ac3fb2f78aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:10.147291 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0a398b1a-a6a9-4f00-9576-a3b6a0bde3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:10.219389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1238/2474] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:10.254618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:10.256618 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:10.315545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0792ab-c68d-4f9b-a5c2-f0150c726558 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:10.319384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d5d5-796b-4fad-bf35-f1e94112ed56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:10.319986 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d5d5-796b-4fad-bf35-f1e94112ed56 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.320267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d5d5-796b-4fad-bf35-f1e94112ed56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.320545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d5d5-796b-4fad-bf35-f1e94112ed56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.329087 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d5d5-796b-4fad-bf35-f1e94112ed56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:10.330553 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d5d5-796b-4fad-bf35-f1e94112ed56 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:10.339806 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1237/2475] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:10.356151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a398b1a-a6a9-4f00-9576-a3b6a0bde3fd None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:10.419908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a398b1a-a6a9-4f00-9576-a3b6a0bde3fd None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:10.424502 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:10.425137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.425416 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.425737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] PATH_INFO: `/v3/users/1f64264d461d47719123ac3fb2f78aac` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.427469 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f64264d461d47719123ac3fb2f78aac)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:10.429397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:10.452296 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:10.481120 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f64264d461d47719123ac3fb2f78aac'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.494448 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f64264d461d47719123ac3fb2f78aac'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.495137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f64264d461d47719123ac3fb2f78aac'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.503402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f64264d461d47719123ac3fb2f78aac'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.504351 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f64264d461d47719123ac3fb2f78aac'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.520754 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1239/2476] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:10 2022] DELETE /identity/v3/users/1f64264d461d47719123ac3fb2f78aac => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:10.525999 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225609-aa27-4af5-b002-3dae739d766c None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.526441 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225609-aa27-4af5-b002-3dae739d766c None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.526703 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e225609-aa27-4af5-b002-3dae739d766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.546620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-7e225609-aa27-4af5-b002-3dae739d766c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:10.547839 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7e225609-aa27-4af5-b002-3dae739d766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:10.592219 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:10.609843 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1238/2477] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:10.621563 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:10.622912 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:10.681048 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93a51-b613-4326-adde-fa3375b177db admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:10.684714 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ef44-f114-4f77-b501-896cea9be217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:10.685320 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ef44-f114-4f77-b501-896cea9be217 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.685752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ef44-f114-4f77-b501-896cea9be217 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.686023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ef44-f114-4f77-b501-896cea9be217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.700576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ef44-f114-4f77-b501-896cea9be217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:10.700576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ef44-f114-4f77-b501-896cea9be217 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:10.706030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1240/2478] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:07:10.735964 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e225609-aa27-4af5-b002-3dae739d766c None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:10.737506 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-7e225609-aa27-4af5-b002-3dae739d766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:10.750773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e225609-aa27-4af5-b002-3dae739d766c None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:10.755609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:10.756235 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.756538 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.756812 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] PATH_INFO: `/v3/users/26cbf8da50354e85b81df742737ec8a6` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.758017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cbf8da50354e85b81df742737ec8a6)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:10.760027 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:10.810044 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cbf8da50354e85b81df742737ec8a6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.822222 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cbf8da50354e85b81df742737ec8a6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.823067 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cbf8da50354e85b81df742737ec8a6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.829919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cbf8da50354e85b81df742737ec8a6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.830571 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cbf8da50354e85b81df742737ec8a6'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:10.843248 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1239/2479] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:10 2022] DELETE /identity/v3/users/26cbf8da50354e85b81df742737ec8a6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:10.851484 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143dcd0-6946-4223-a9b1-53c5b4aa3010 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:10.851484 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143dcd0-6946-4223-a9b1-53c5b4aa3010 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:10.851686 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143dcd0-6946-4223-a9b1-53c5b4aa3010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:10.872292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-7143dcd0-6946-4223-a9b1-53c5b4aa3010 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:10.873598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7143dcd0-6946-4223-a9b1-53c5b4aa3010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:10.935974 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1241/2480] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:10.946084 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:10.947514 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:10.987987 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143dcd0-6946-4223-a9b1-53c5b4aa3010 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:10.990020 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-7143dcd0-6946-4223-a9b1-53c5b4aa3010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.002160 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143dcd0-6946-4223-a9b1-53c5b4aa3010 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.007638 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.008270 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.008540 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.008806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] PATH_INFO: `/v3/projects/cde15c9a4573452094625a1bc31e0717` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.009975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde15c9a4573452094625a1bc31e0717)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.011881 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.021254 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86c53-93fd-4bc4-a105-52b20e5413fd admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.025300 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48949ace-6406-44e4-aefe-5891da538949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.026277 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949ace-6406-44e4-aefe-5891da538949 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.026583 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949ace-6406-44e4-aefe-5891da538949 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.026850 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949ace-6406-44e4-aefe-5891da538949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.036476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48949ace-6406-44e4-aefe-5891da538949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.037937 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48949ace-6406-44e4-aefe-5891da538949 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.048299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1240/2481] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:11.053604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:11.064487 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde15c9a4573452094625a1bc31e0717', 'request_id': 'req-62fe716d-c3a9-4903-b607-c502cf00e921'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.070693 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde15c9a4573452094625a1bc31e0717', 'request_id': 'req-62fe716d-c3a9-4903-b607-c502cf00e921'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.077136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde15c9a4573452094625a1bc31e0717', 'request_id': 'req-62fe716d-c3a9-4903-b607-c502cf00e921'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.090532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] The token cache is being invalidate because project cde15c9a4573452094625a1bc31e0717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:11.090909 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.091619 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-62fe716d-c3a9-4903-b607-c502cf00e921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.093443 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1242/2482] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:10 2022] DELETE /identity/v3/projects/cde15c9a4573452094625a1bc31e0717 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:07:11.098958 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1f77-a740-45d3-aaad-3bdf37cccb33 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.099241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1f77-a740-45d3-aaad-3bdf37cccb33 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.099507 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b1f77-a740-45d3-aaad-3bdf37cccb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.121128 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-927b1f77-a740-45d3-aaad-3bdf37cccb33 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:11.122433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-927b1f77-a740-45d3-aaad-3bdf37cccb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.184337 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1241/2483] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:11.192176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc884-3574-42c2-8322-2f44a21f6539 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.193213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc884-3574-42c2-8322-2f44a21f6539 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.193588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc884-3574-42c2-8322-2f44a21f6539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.214329 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-578bc884-3574-42c2-8322-2f44a21f6539 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:11.215553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-578bc884-3574-42c2-8322-2f44a21f6539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.224247 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1243/2484] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:11.228773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b1f77-a740-45d3-aaad-3bdf37cccb33 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.235519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:11.239321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b1f77-a740-45d3-aaad-3bdf37cccb33 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.246073 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.246990 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.247494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.247841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.248628 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:07:11.249175 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.250883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.265510 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1242/2485] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:07:11.267207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bc884-3574-42c2-8322-2f44a21f6539 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.277434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bc884-3574-42c2-8322-2f44a21f6539 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.282223 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.282828 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.283108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.283377 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.284005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.286482 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.314962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1244/2486] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:11.319489 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.328089 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.329757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.330672 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bf06b-e212-4fbe-ad7c-a0cea9a76cc0 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.399174 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbec3f-b0db-4c36-b044-bbb049ef0cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.399773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbec3f-b0db-4c36-b044-bbb049ef0cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.400046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbec3f-b0db-4c36-b044-bbb049ef0cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.400232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd4d8c-9a3e-41c2-beb0-9662e3829c35 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.400363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbec3f-b0db-4c36-b044-bbb049ef0cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.400923 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbec3f-b0db-4c36-b044-bbb049ef0cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.402929 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbec3f-b0db-4c36-b044-bbb049ef0cd7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.405049 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.405708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.405989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.406261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] PATH_INFO: `/v3/projects/120281a4208b41979b89ded34ce9e0cd` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.407423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] RBAC: Authorizing `identity:delete_project(project_id=120281a4208b41979b89ded34ce9e0cd)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.409701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.424659 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1243/2487] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:07:11.428848 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbec3f-b0db-4c36-b044-bbb049ef0cd7 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.438183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbec3f-b0db-4c36-b044-bbb049ef0cd7 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.443433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61207a-7932-483a-9b87-610d88f8e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.444114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61207a-7932-483a-9b87-610d88f8e425 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.444463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61207a-7932-483a-9b87-610d88f8e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.444803 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61207a-7932-483a-9b87-610d88f8e425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.445549 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61207a-7932-483a-9b87-610d88f8e425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.447198 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61207a-7932-483a-9b87-610d88f8e425 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.458719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1244/2488] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:07:11.462191 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61207a-7932-483a-9b87-610d88f8e425 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.462348 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120281a4208b41979b89ded34ce9e0cd', 'request_id': 'req-3d0c9d8a-2493-4f43-aca7-406e6123e85b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.468100 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120281a4208b41979b89ded34ce9e0cd', 'request_id': 'req-3d0c9d8a-2493-4f43-aca7-406e6123e85b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.472255 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61207a-7932-483a-9b87-610d88f8e425 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.475002 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120281a4208b41979b89ded34ce9e0cd', 'request_id': 'req-3d0c9d8a-2493-4f43-aca7-406e6123e85b'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.488811 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] The token cache is being invalidate because project 120281a4208b41979b89ded34ce9e0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:11.488997 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.489705 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-3d0c9d8a-2493-4f43-aca7-406e6123e85b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:11.491372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1245/2489] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:11 2022] DELETE /identity/v3/projects/120281a4208b41979b89ded34ce9e0cd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:07:11.496098 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257c3dc-78c8-437b-87fb-8c9ac6bfee74 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.496372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257c3dc-78c8-437b-87fb-8c9ac6bfee74 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.496640 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257c3dc-78c8-437b-87fb-8c9ac6bfee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.515610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1257c3dc-78c8-437b-87fb-8c9ac6bfee74 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:11.516807 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1257c3dc-78c8-437b-87fb-8c9ac6bfee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.532730 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.533328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.533641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.533909 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.534545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.536665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.539955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:11.546734 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1245/2490] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:07:11.551239 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.553161 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.565398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327d36-f4a5-41e9-bbf1-59b1879b97d7 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.570361 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba08e2-d02a-40de-b452-d23be70cf05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.571006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba08e2-d02a-40de-b452-d23be70cf05b admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.571309 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba08e2-d02a-40de-b452-d23be70cf05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.571584 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba08e2-d02a-40de-b452-d23be70cf05b admin admin] PATH_INFO: `/v3/projects/2e2dca122975414d97784b2d1bdc952f/users/6a3f10b7e1bb495995e49868477e2d9a/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.583915 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1246/2491] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:07:11.587315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba08e2-d02a-40de-b452-d23be70cf05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2dca122975414d97784b2d1bdc952f, user_id=6a3f10b7e1bb495995e49868477e2d9a, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.590117 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba08e2-d02a-40de-b452-d23be70cf05b admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.591333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fbf-0625-4d88-acff-6ed557cb0e6c None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.591622 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fbf-0625-4d88-acff-6ed557cb0e6c None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.591893 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fbf-0625-4d88-acff-6ed557cb0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.603918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1246/2492] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:07:11 2022] PUT /identity/v3/projects/2e2dca122975414d97784b2d1bdc952f/users/6a3f10b7e1bb495995e49868477e2d9a/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:11.612560 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-d3d39fbf-0625-4d88-acff-6ed557cb0e6c None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:11.614079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d3d39fbf-0625-4d88-acff-6ed557cb0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.614420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc98dc-20dc-4e5b-bc7d-49add0263fc2 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.614852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc98dc-20dc-4e5b-bc7d-49add0263fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.615133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc98dc-20dc-4e5b-bc7d-49add0263fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.646127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-19dc98dc-20dc-4e5b-bc7d-49add0263fc2 None None] MFA Rules not processed for user `6a3f10b7e1bb495995e49868477e2d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:11.647837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-19dc98dc-20dc-4e5b-bc7d-49add0263fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.676121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1247/2493] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:07:11.678186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:11.681140 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39fbf-0625-4d88-acff-6ed557cb0e6c None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.689980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39fbf-0625-4d88-acff-6ed557cb0e6c None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.695056 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.695728 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.696070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.696412 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.697054 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:07:11.697354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.698981 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.713524 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1248/2494] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:07:11.715115 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.717897 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1247/2495] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:07:11.727521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c670-d2a7-4617-a360-72437feee3b3 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.729544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc98dc-20dc-4e5b-bc7d-49add0263fc2 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.730883 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-19dc98dc-20dc-4e5b-bc7d-49add0263fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.732975 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251faeb-8be5-4668-a2d8-4eef40a8c0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.733406 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251faeb-8be5-4668-a2d8-4eef40a8c0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.733715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251faeb-8be5-4668-a2d8-4eef40a8c0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.734102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251faeb-8be5-4668-a2d8-4eef40a8c0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.734788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251faeb-8be5-4668-a2d8-4eef40a8c0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.736947 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251faeb-8be5-4668-a2d8-4eef40a8c0e9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.771361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1249/2496] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:07:11.775389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251faeb-8be5-4668-a2d8-4eef40a8c0e9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.795859 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc98dc-20dc-4e5b-bc7d-49add0263fc2 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.847441 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251faeb-8be5-4668-a2d8-4eef40a8c0e9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.849230 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9db863-aaf1-4b64-a37e-c124c9285e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.849879 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9db863-aaf1-4b64-a37e-c124c9285e6b service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.850162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9db863-aaf1-4b64-a37e-c124c9285e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.850537 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9db863-aaf1-4b64-a37e-c124c9285e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.853446 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55563bbe-2dee-49cc-bdbd-814a88d1b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.854085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563bbe-2dee-49cc-bdbd-814a88d1b5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.854385 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563bbe-2dee-49cc-bdbd-814a88d1b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.854653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563bbe-2dee-49cc-bdbd-814a88d1b5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.855316 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55563bbe-2dee-49cc-bdbd-814a88d1b5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.857380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55563bbe-2dee-49cc-bdbd-814a88d1b5e9 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.885518 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1250/2497] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:07:11 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:07:11.888643 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55563bbe-2dee-49cc-bdbd-814a88d1b5e9 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.900797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55563bbe-2dee-49cc-bdbd-814a88d1b5e9 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.906114 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1ea1f-bc99-47d4-b71c-93bc01deabe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.906849 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1ea1f-bc99-47d4-b71c-93bc01deabe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.907125 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1ea1f-bc99-47d4-b71c-93bc01deabe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.907395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1ea1f-bc99-47d4-b71c-93bc01deabe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.908029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1ea1f-bc99-47d4-b71c-93bc01deabe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.909655 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1ea1f-bc99-47d4-b71c-93bc01deabe2 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.914451 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9db863-aaf1-4b64-a37e-c124c9285e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.915894 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9db863-aaf1-4b64-a37e-c124c9285e6b service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.923706 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1251/2498] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:11.924785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1ea1f-bc99-47d4-b71c-93bc01deabe2 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.926070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1248/2499] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:07:11.937410 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1ea1f-bc99-47d4-b71c-93bc01deabe2 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.942725 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2368-4fc5-4631-b5fe-5ed71240524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.943597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2368-4fc5-4631-b5fe-5ed71240524d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.943927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2368-4fc5-4631-b5fe-5ed71240524d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.944343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2368-4fc5-4631-b5fe-5ed71240524d admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.945206 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2368-4fc5-4631-b5fe-5ed71240524d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.946937 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2368-4fc5-4631-b5fe-5ed71240524d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.949236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:11.952494 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9db863-aaf1-4b64-a37e-c124c9285e6b service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.964290 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1252/2500] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:07:11.964491 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9db863-aaf1-4b64-a37e-c124c9285e6b service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.965595 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2368-4fc5-4631-b5fe-5ed71240524d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.969616 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.970320 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.970668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.971011 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] PATH_INFO: `/v3/users/6a3f10b7e1bb495995e49868477e2d9a` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.972340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3f10b7e1bb495995e49868477e2d9a)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.974519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.988236 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2368-4fc5-4631-b5fe-5ed71240524d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.994723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149959c5-d240-4f21-ba33-4aa3b856c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.995566 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149959c5-d240-4f21-ba33-4aa3b856c4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.995914 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149959c5-d240-4f21-ba33-4aa3b856c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.996248 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149959c5-d240-4f21-ba33-4aa3b856c4f6 admin admin] PATH_INFO: `/v3/projects/d706f9bb1674441190a57bc1d1cc6c14/users/aa1d38a9d67b44a1b1321586e43e43e0/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:12.016138 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149959c5-d240-4f21-ba33-4aa3b856c4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d706f9bb1674441190a57bc1d1cc6c14, user_id=aa1d38a9d67b44a1b1321586e43e43e0, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:12.017821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:12.018941 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149959c5-d240-4f21-ba33-4aa3b856c4f6 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:12.029579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3f10b7e1bb495995e49868477e2d9a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.033960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1253/2501] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:07:11 2022] PUT /identity/v3/projects/d706f9bb1674441190a57bc1d1cc6c14/users/aa1d38a9d67b44a1b1321586e43e43e0/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:12.043116 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3f10b7e1bb495995e49868477e2d9a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.044076 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3f10b7e1bb495995e49868477e2d9a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.045172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9f73-c249-4b25-8c2c-cf30a5460c25 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:12.045458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9f73-c249-4b25-8c2c-cf30a5460c25 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:12.045778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9f73-c249-4b25-8c2c-cf30a5460c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:12.053600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3f10b7e1bb495995e49868477e2d9a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.055072 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-eb1ba23c-acf3-464c-bd3a-dba0824e6229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3f10b7e1bb495995e49868477e2d9a'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.071039 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1249/2502] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:11 2022] DELETE /identity/v3/users/6a3f10b7e1bb495995e49868477e2d9a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:12.075086 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0693c3-d12a-4a7f-b77a-0cfcd2331570 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:12.075457 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0693c3-d12a-4a7f-b77a-0cfcd2331570 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:12.075636 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0693c3-d12a-4a7f-b77a-0cfcd2331570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:12.077367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-50ed9f73-c249-4b25-8c2c-cf30a5460c25 None None] MFA Rules not processed for user `aa1d38a9d67b44a1b1321586e43e43e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:12.078819 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-50ed9f73-c249-4b25-8c2c-cf30a5460c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:12.096870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ea0693c3-d12a-4a7f-b77a-0cfcd2331570 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:12.098513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ea0693c3-d12a-4a7f-b77a-0cfcd2331570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:12.163395 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1254/2503] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:07:12.173620 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1250/2504] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:07:12.175481 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9f73-c249-4b25-8c2c-cf30a5460c25 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:12.177434 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-50ed9f73-c249-4b25-8c2c-cf30a5460c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:12.180841 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0693c3-d12a-4a7f-b77a-0cfcd2331570 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:12.182446 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ea0693c3-d12a-4a7f-b77a-0cfcd2331570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:12.238096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9f73-c249-4b25-8c2c-cf30a5460c25 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:12.242656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3697284166c042d79d946ef469932562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:12.243374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:12.243734 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:12.244070 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:12.252865 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:12.254431 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:12.255938 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0693c3-d12a-4a7f-b77a-0cfcd2331570 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:12.260984 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470ad52-6185-4b52-ab4f-3d59c84d0905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:12.261822 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ad52-6185-4b52-ab4f-3d59c84d0905 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:12.262648 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ad52-6185-4b52-ab4f-3d59c84d0905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:12.263074 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470ad52-6185-4b52-ab4f-3d59c84d0905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:12.265610 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1255/2505] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:12.274516 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470ad52-6185-4b52-ab4f-3d59c84d0905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:12.276313 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470ad52-6185-4b52-ab4f-3d59c84d0905 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:12.290261 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1251/2506] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:12.624967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:12.626305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:12.651644 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad200c9-8576-4464-b912-22540cd81248 service glance] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:12.657613 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:12.658254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:12.658528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:12.658798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] PATH_INFO: `/v3/projects/2e2dca122975414d97784b2d1bdc952f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:12.660471 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2dca122975414d97784b2d1bdc952f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:12.662943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:12.714670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2dca122975414d97784b2d1bdc952f', 'request_id': 'req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.721346 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2dca122975414d97784b2d1bdc952f', 'request_id': 'req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.723955 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:12.737361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2dca122975414d97784b2d1bdc952f', 'request_id': 'req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.752736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] The token cache is being invalidate because project 2e2dca122975414d97784b2d1bdc952f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:12.753106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.753907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-0ba1e9f1-3b77-4229-a9fd-c67be00fcdf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:12.755501 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1256/2507] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:12 2022] DELETE /identity/v3/projects/2e2dca122975414d97784b2d1bdc952f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:14.103536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94914a5-3e28-48c7-9d11-473c315079a4 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:14.104082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94914a5-3e28-48c7-9d11-473c315079a4 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:14.104082 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94914a5-3e28-48c7-9d11-473c315079a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:14.123480 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a94914a5-3e28-48c7-9d11-473c315079a4 None None] MFA Rules not processed for user `52ef0190e0854ed1b9b1e08224e7390d`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:14.124752 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a94914a5-3e28-48c7-9d11-473c315079a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:14.180530 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1252/2508] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:22.749135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:24.173282 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:35.668065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8458e7a-70ef-4ad6-b33b-2ad262161933 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:35.669102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8458e7a-70ef-4ad6-b33b-2ad262161933 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:35.669727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8458e7a-70ef-4ad6-b33b-2ad262161933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:35.692480 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-a8458e7a-70ef-4ad6-b33b-2ad262161933 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:35.693802 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a8458e7a-70ef-4ad6-b33b-2ad262161933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:35.754569 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1257/2509] 10.222.0.47 () {58 vars in 1009 bytes} [Fri Oct 14 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:35.798365 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94914a5-3e28-48c7-9d11-473c315079a4 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:35.799778 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a94914a5-3e28-48c7-9d11-473c315079a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:35.867289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94914a5-3e28-48c7-9d11-473c315079a4 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:35.872267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06cb3b-fd77-4806-9888-f7309ef6468e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:35.872862 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06cb3b-fd77-4806-9888-f7309ef6468e service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:35.873135 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06cb3b-fd77-4806-9888-f7309ef6468e service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:35.873400 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06cb3b-fd77-4806-9888-f7309ef6468e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:35.881732 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06cb3b-fd77-4806-9888-f7309ef6468e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:35.883346 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06cb3b-fd77-4806-9888-f7309ef6468e service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:35.891371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1253/2510] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:07:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:07:40.358392 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8458e7a-70ef-4ad6-b33b-2ad262161933 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:40.359885 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-a8458e7a-70ef-4ad6-b33b-2ad262161933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:40.562217 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8458e7a-70ef-4ad6-b33b-2ad262161933 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:40.568660 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:40.569476 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:40.569798 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:40.570119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] PATH_INFO: `/v3/users/aa1d38a9d67b44a1b1321586e43e43e0` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:40.571330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1d38a9d67b44a1b1321586e43e43e0)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:40.573366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:40.660532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:40.662341 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1d38a9d67b44a1b1321586e43e43e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:40.686223 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1d38a9d67b44a1b1321586e43e43e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:40.687470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1d38a9d67b44a1b1321586e43e43e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:40.698376 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1d38a9d67b44a1b1321586e43e43e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:40.699730 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1d38a9d67b44a1b1321586e43e43e0'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:40.734196 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1258/2511] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:40 2022] DELETE /identity/v3/users/aa1d38a9d67b44a1b1321586e43e43e0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:40.735707 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112bb49-49a3-45d2-b11b-d0ce572b5851 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:40.736242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112bb49-49a3-45d2-b11b-d0ce572b5851 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:40.736242 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112bb49-49a3-45d2-b11b-d0ce572b5851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:40.829509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c112bb49-49a3-45d2-b11b-d0ce572b5851 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:40.829509 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c112bb49-49a3-45d2-b11b-d0ce572b5851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:40.902810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1254/2512] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:07:40.914403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:40.916016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:41.052178 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77326e28-1105-4445-88f7-39db43eaafb7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:41.056418 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3339e2-c643-4446-90aa-093a54aa802b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:41.057091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3339e2-c643-4446-90aa-093a54aa802b service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:41.057620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3339e2-c643-4446-90aa-093a54aa802b service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:41.057902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3339e2-c643-4446-90aa-093a54aa802b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:41.069634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3339e2-c643-4446-90aa-093a54aa802b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:41.071576 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3339e2-c643-4446-90aa-093a54aa802b service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:41.083627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1259/2513] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:41.424528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112bb49-49a3-45d2-b11b-d0ce572b5851 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:41.426818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c112bb49-49a3-45d2-b11b-d0ce572b5851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:41.451171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112bb49-49a3-45d2-b11b-d0ce572b5851 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:41.456581 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:41.457426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:41.457899 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:41.458061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] PATH_INFO: `/v3/projects/d706f9bb1674441190a57bc1d1cc6c14` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:41.459444 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d706f9bb1674441190a57bc1d1cc6c14)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:41.471854 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:41.559650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd706f9bb1674441190a57bc1d1cc6c14', 'request_id': 'req-d8f55829-16df-4321-a869-3da9c8e83667'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:41.567845 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd706f9bb1674441190a57bc1d1cc6c14', 'request_id': 'req-d8f55829-16df-4321-a869-3da9c8e83667'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:41.576070 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd706f9bb1674441190a57bc1d1cc6c14', 'request_id': 'req-d8f55829-16df-4321-a869-3da9c8e83667'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:41.590608 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] The token cache is being invalidate because project d706f9bb1674441190a57bc1d1cc6c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:41.591061 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:41.591821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-d8f55829-16df-4321-a869-3da9c8e83667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:41.593472 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1255/2514] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:41 2022] DELETE /identity/v3/projects/d706f9bb1674441190a57bc1d1cc6c14 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:41.599180 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d249d-e47e-450d-9129-c1930a2aca27 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:41.599739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d249d-e47e-450d-9129-c1930a2aca27 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:41.599739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d249d-e47e-450d-9129-c1930a2aca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:41.656127 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-e70d249d-e47e-450d-9129-c1930a2aca27 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:41.657421 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e70d249d-e47e-450d-9129-c1930a2aca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:41.732618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1260/2515] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:41.741148 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e746-b5c6-44e1-9f68-1e4800e0f2da None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:41.741910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e746-b5c6-44e1-9f68-1e4800e0f2da None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:41.742063 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099e746-b5c6-44e1-9f68-1e4800e0f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:41.760928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:41.766928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-a099e746-b5c6-44e1-9f68-1e4800e0f2da None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:41.769267 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a099e746-b5c6-44e1-9f68-1e4800e0f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:41.778882 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1256/2516] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:41.783167 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d249d-e47e-450d-9129-c1930a2aca27 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:41.794431 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d249d-e47e-450d-9129-c1930a2aca27 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:41.799492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:41.800298 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:41.801354 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:41.804299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:41.804299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:07:41.804299 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:41.806035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:41.819472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1261/2517] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:07:41.824303 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099e746-b5c6-44e1-9f68-1e4800e0f2da None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:41.836821 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099e746-b5c6-44e1-9f68-1e4800e0f2da None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:41.842097 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af71ba-8c11-4032-992b-204f3643e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:41.843787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af71ba-8c11-4032-992b-204f3643e9fa admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:41.843787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af71ba-8c11-4032-992b-204f3643e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:41.843787 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af71ba-8c11-4032-992b-204f3643e9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:41.844818 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af71ba-8c11-4032-992b-204f3643e9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:41.848861 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af71ba-8c11-4032-992b-204f3643e9fa admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:41.888900 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1257/2518] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:07:41 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:07:41.893207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:41.911707 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113acbc-d92c-4242-889c-dee7f2fc839d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:41.921827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:41.999252 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c74eb-af1b-4ff3-84cb-44a91a102186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:42.000042 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c74eb-af1b-4ff3-84cb-44a91a102186 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:42.000220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c74eb-af1b-4ff3-84cb-44a91a102186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:42.000473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c74eb-af1b-4ff3-84cb-44a91a102186 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:42.001155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c74eb-af1b-4ff3-84cb-44a91a102186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:42.003219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c74eb-af1b-4ff3-84cb-44a91a102186 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:42.033414 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1262/2519] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:07:41 2022] POST /identity/v3/users => generated 283 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:42.035782 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af71ba-8c11-4032-992b-204f3643e9fa admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:42.050679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af71ba-8c11-4032-992b-204f3643e9fa admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:42.067550 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91f40-3112-4b16-99ec-173e9b3a7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:42.069308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91f40-3112-4b16-99ec-173e9b3a7af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:42.070340 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91f40-3112-4b16-99ec-173e9b3a7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:42.077350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91f40-3112-4b16-99ec-173e9b3a7af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:42.078420 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd91f40-3112-4b16-99ec-173e9b3a7af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:42.080573 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd91f40-3112-4b16-99ec-173e9b3a7af6 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:42.110904 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1258/2520] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:07:42.112494 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c74eb-af1b-4ff3-84cb-44a91a102186 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:42.126135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c74eb-af1b-4ff3-84cb-44a91a102186 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:42.130994 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395496cc-1e30-42d8-915b-75c9db39cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:42.131597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395496cc-1e30-42d8-915b-75c9db39cd2c admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:42.131872 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395496cc-1e30-42d8-915b-75c9db39cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:42.133520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395496cc-1e30-42d8-915b-75c9db39cd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:42.133520 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395496cc-1e30-42d8-915b-75c9db39cd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:42.134911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395496cc-1e30-42d8-915b-75c9db39cd2c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:42.157554 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1263/2521] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:42.161702 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91f40-3112-4b16-99ec-173e9b3a7af6 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:42.178475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91f40-3112-4b16-99ec-173e9b3a7af6 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:42.183679 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:42.184519 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:42.185028 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:42.185406 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] PATH_INFO: `/v3/projects/ddb002b2b7a44d61801ae74f63b47ba7/users/ea5ee94ff63a45de825c90dd9d30c4ff/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:42.202738 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb002b2b7a44d61801ae74f63b47ba7, user_id=ea5ee94ff63a45de825c90dd9d30c4ff, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:42.208179 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:42.226278 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1259/2522] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:07:42 2022] PUT /identity/v3/projects/ddb002b2b7a44d61801ae74f63b47ba7/users/ea5ee94ff63a45de825c90dd9d30c4ff/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:42.238239 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947e84-d5e8-4358-883b-1836522a3d99 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:42.238597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947e84-d5e8-4358-883b-1836522a3d99 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:42.238976 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947e84-d5e8-4358-883b-1836522a3d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:42.270654 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-1b947e84-d5e8-4358-883b-1836522a3d99 None None] MFA Rules not processed for user `ea5ee94ff63a45de825c90dd9d30c4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:42.272014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1b947e84-d5e8-4358-883b-1836522a3d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:42.358144 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1264/2523] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:42.365956 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:42.367842 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:42.431315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd22f9-8685-496f-bd8a-256962ab173e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:42.436786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:42.437473 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:42.437786 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:42.438068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:42.447994 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:42.449418 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:42.459304 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1260/2524] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:07:52.350232 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=60,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:52.454331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:53.732195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62472780-bdfc-4be1-bcf1-096202f5bc66 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:53.732667 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62472780-bdfc-4be1-bcf1-096202f5bc66 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:53.732774 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62472780-bdfc-4be1-bcf1-096202f5bc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:53.763831 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-62472780-bdfc-4be1-bcf1-096202f5bc66 None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:53.765029 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-62472780-bdfc-4be1-bcf1-096202f5bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:53.825367 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1265/2525] 10.222.0.47 () {58 vars in 967 bytes} [Fri Oct 14 13:07:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:53.837526 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:53.838933 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:53.906804 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f2c7b-8634-4dfa-86c6-8d934cdd4e73 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:53.912316 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5c751-8c98-4750-b1a6-f1276c1bd14f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:53.912910 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5c751-8c98-4750-b1a6-f1276c1bd14f service swift] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:53.913186 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5c751-8c98-4750-b1a6-f1276c1bd14f service swift] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:53.913454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5c751-8c98-4750-b1a6-f1276c1bd14f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:53.921212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5c751-8c98-4750-b1a6-f1276c1bd14f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:53.922795 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5c751-8c98-4750-b1a6-f1276c1bd14f service swift] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:53.931228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1261/2526] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:07:55.953286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62472780-bdfc-4be1-bcf1-096202f5bc66 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:55.954752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-62472780-bdfc-4be1-bcf1-096202f5bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:56.023157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62472780-bdfc-4be1-bcf1-096202f5bc66 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:56.027602 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:56.028228 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.028503 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.028779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] PATH_INFO: `/v3/users/52ef0190e0854ed1b9b1e08224e7390d` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.029957 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ef0190e0854ed1b9b1e08224e7390d)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:56.031868 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:56.076454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ef0190e0854ed1b9b1e08224e7390d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.088824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ef0190e0854ed1b9b1e08224e7390d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.089474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ef0190e0854ed1b9b1e08224e7390d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.096718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ef0190e0854ed1b9b1e08224e7390d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.097533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-4381df5c-5e5b-4794-8a8b-787c6e1f5079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ef0190e0854ed1b9b1e08224e7390d'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.109451 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1266/2527] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:07:55 2022] DELETE /identity/v3/users/52ef0190e0854ed1b9b1e08224e7390d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:56.279381 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5c751-8c98-4750-b1a6-f1276c1bd14f service swift] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:56.290005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5c751-8c98-4750-b1a6-f1276c1bd14f service swift] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:56.348551 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:56.349171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.349448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.349935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] PATH_INFO: `/v3/projects/ced93fb9d5dd4cbda0272ba5477b39c9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.351285 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced93fb9d5dd4cbda0272ba5477b39c9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:56.353287 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:56.399965 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'request_id': 'req-952f09f4-b790-46df-9cac-d039a59a0abc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.405305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'request_id': 'req-952f09f4-b790-46df-9cac-d039a59a0abc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.411385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'request_id': 'req-952f09f4-b790-46df-9cac-d039a59a0abc'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.423388 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] The token cache is being invalidate because project ced93fb9d5dd4cbda0272ba5477b39c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:07:56.423677 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.424290 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-952f09f4-b790-46df-9cac-d039a59a0abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:07:56.425825 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1262/2528] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:07:56 2022] DELETE /identity/v3/projects/ced93fb9d5dd4cbda0272ba5477b39c9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:56.431226 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bc4c-a479-4bdc-b027-b02d5adefd1d None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.431509 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bc4c-a479-4bdc-b027-b02d5adefd1d None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.431780 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8bc4c-a479-4bdc-b027-b02d5adefd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.451428 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-34a8bc4c-a479-4bdc-b027-b02d5adefd1d None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:56.452621 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-34a8bc4c-a479-4bdc-b027-b02d5adefd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:56.456813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:56.512286 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1267/2529] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:56.519831 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f81ca-8449-4827-9001-6e70097b6b1e None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.520133 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f81ca-8449-4827-9001-6e70097b6b1e None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.520421 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f81ca-8449-4827-9001-6e70097b6b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.540146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-ff7f81ca-8449-4827-9001-6e70097b6b1e None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:56.541374 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ff7f81ca-8449-4827-9001-6e70097b6b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:56.549171 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1263/2530] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:56.553823 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8bc4c-a479-4bdc-b027-b02d5adefd1d None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:56.563772 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8bc4c-a479-4bdc-b027-b02d5adefd1d None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:56.568591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:56.569208 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.569470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.569778 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] PATH_INFO: `/v3/domains` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.570423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:07:56.570729 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:56.572353 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:56.583715 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1268/2531] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:07:56.587976 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f81ca-8449-4827-9001-6e70097b6b1e None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:56.597155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f81ca-8449-4827-9001-6e70097b6b1e None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:56.602436 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebddb7f-0eb3-48c4-b4a7-46a893cdc698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:56.603031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebddb7f-0eb3-48c4-b4a7-46a893cdc698 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.603306 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebddb7f-0eb3-48c4-b4a7-46a893cdc698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.603579 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebddb7f-0eb3-48c4-b4a7-46a893cdc698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.604204 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebddb7f-0eb3-48c4-b4a7-46a893cdc698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:56.606131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebddb7f-0eb3-48c4-b4a7-46a893cdc698 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:56.618136 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:56.634605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1264/2532] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:07:56 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:56.638760 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:56.648727 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4059e1-beb9-4a34-ab43-23cea451dcab admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:56.703820 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe58dff-d1bc-45af-9d5b-443f441cf25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:56.704423 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58dff-d1bc-45af-9d5b-443f441cf25b admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.704701 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58dff-d1bc-45af-9d5b-443f441cf25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.704972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58dff-d1bc-45af-9d5b-443f441cf25b admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.705627 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe58dff-d1bc-45af-9d5b-443f441cf25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:56.707603 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe58dff-d1bc-45af-9d5b-443f441cf25b admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:56.728863 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1269/2533] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:07:56 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:07:56.732884 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebddb7f-0eb3-48c4-b4a7-46a893cdc698 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:56.744007 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebddb7f-0eb3-48c4-b4a7-46a893cdc698 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:56.748592 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45330b-dbe0-401b-85c5-bcb7babfdf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:56.749193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45330b-dbe0-401b-85c5-bcb7babfdf19 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.749471 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45330b-dbe0-401b-85c5-bcb7babfdf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.749776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45330b-dbe0-401b-85c5-bcb7babfdf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.750423 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45330b-dbe0-401b-85c5-bcb7babfdf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:56.752001 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45330b-dbe0-401b-85c5-bcb7babfdf19 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:56.763000 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1265/2534] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:56.766794 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe58dff-d1bc-45af-9d5b-443f441cf25b admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:56.776933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe58dff-d1bc-45af-9d5b-443f441cf25b admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:56.781658 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94b028-a23e-4947-84f0-917eb7be8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:56.782258 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b028-a23e-4947-84f0-917eb7be8d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.782538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b028-a23e-4947-84f0-917eb7be8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.782810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94b028-a23e-4947-84f0-917eb7be8d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.783512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94b028-a23e-4947-84f0-917eb7be8d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:56.785244 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94b028-a23e-4947-84f0-917eb7be8d67 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:56.799380 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1270/2535] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:07:56.800716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45330b-dbe0-401b-85c5-bcb7babfdf19 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:56.812292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45330b-dbe0-401b-85c5-bcb7babfdf19 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:56.817085 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:56.817913 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.818192 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.818462 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] PATH_INFO: `/v3/projects/bec5bb9b1b73416fb97534f476f2dce2/users/72c8077c28fa40a99c090dc6b11a769b/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.834617 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec5bb9b1b73416fb97534f476f2dce2, user_id=72c8077c28fa40a99c090dc6b11a769b, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:56.837343 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:56.853568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1266/2536] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:07:56 2022] PUT /identity/v3/projects/bec5bb9b1b73416fb97534f476f2dce2/users/72c8077c28fa40a99c090dc6b11a769b/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:07:56.856007 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4850-ed78-4e9d-8450-afeefcd12ba4 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:56.856254 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4850-ed78-4e9d-8450-afeefcd12ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:56.856532 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4850-ed78-4e9d-8450-afeefcd12ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:56.877550 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-42ae4850-ed78-4e9d-8450-afeefcd12ba4 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:56.878902 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-42ae4850-ed78-4e9d-8450-afeefcd12ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:56.938549 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1271/2537] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:56.948120 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:56.949888 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:57.010005 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4f09-4fa1-4916-999e-d7a1ec6cd981 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:57.013941 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:57.014536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:57.014809 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:57.015078 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:57.024339 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:57.025768 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:57.036849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1267/2538] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:57.653718 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32200dff-dbd3-48ec-9de5-459dce9aa4d1 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:57.654243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32200dff-dbd3-48ec-9de5-459dce9aa4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:57.654243 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32200dff-dbd3-48ec-9de5-459dce9aa4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:57.683078 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-32200dff-dbd3-48ec-9de5-459dce9aa4d1 None None] MFA Rules not processed for user `72c8077c28fa40a99c090dc6b11a769b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:57.684281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-32200dff-dbd3-48ec-9de5-459dce9aa4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:57.688567 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:57.758620 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1272/2539] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:57.770121 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:57.771574 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:57.830311 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbf42f-0e5e-4e8c-b142-85f3b1bc7350 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:57.834006 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0c29-51fc-48fa-971b-591a446902e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:57.834610 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0c29-51fc-48fa-971b-591a446902e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:57.834886 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0c29-51fc-48fa-971b-591a446902e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:57.835155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0c29-51fc-48fa-971b-591a446902e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:57.843419 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0c29-51fc-48fa-971b-591a446902e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:57.844837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0c29-51fc-48fa-971b-591a446902e8 service cinder] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:57.854080 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1268/2540] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:59.231960 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6274-27b1-40f2-9d42-720b151baf3a None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:59.232537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6274-27b1-40f2-9d42-720b151baf3a None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:59.232537 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6274-27b1-40f2-9d42-720b151baf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:59.253220 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-0eac6274-27b1-40f2-9d42-720b151baf3a None None] MFA Rules not processed for user `72c8077c28fa40a99c090dc6b11a769b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:59.254470 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0eac6274-27b1-40f2-9d42-720b151baf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:59.262452 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1273/2541] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:07:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:59.503103 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0c29-51fc-48fa-971b-591a446902e8 service cinder] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:59.522641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0c29-51fc-48fa-971b-591a446902e8 service cinder] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:59.526390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:59.526989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:59.527268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:59.527538 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:59.529289 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:59.552633 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:59.554069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:59.562751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1269/2542] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:08:01.378374 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6274-27b1-40f2-9d42-720b151baf3a None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:01.379776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-0eac6274-27b1-40f2-9d42-720b151baf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:01.471961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6274-27b1-40f2-9d42-720b151baf3a None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:01.477968 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e16c70-fdee-4ada-ba01-e28c24dc411b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:01.478573 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16c70-fdee-4ada-ba01-e28c24dc411b service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:01.478871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16c70-fdee-4ada-ba01-e28c24dc411b service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:01.479137 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16c70-fdee-4ada-ba01-e28c24dc411b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:01.480851 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-65e16c70-fdee-4ada-ba01-e28c24dc411b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:01.493249 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e16c70-fdee-4ada-ba01-e28c24dc411b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:01.494741 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e16c70-fdee-4ada-ba01-e28c24dc411b service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:01.505477 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1274/2543] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:08:09.558857 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=85,keystone:INSERT=2 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:11.500911 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=69 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:17.132783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:17.134212 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:17.148962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f3cfe-a24e-431a-9829-fdae79ab529f service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:17.153777 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:17.154403 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:17.154681 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:17.154987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] PATH_INFO: `/v3/users/ea5ee94ff63a45de825c90dd9d30c4ff` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:17.156155 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5ee94ff63a45de825c90dd9d30c4ff)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:17.158130 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:17.211488 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5ee94ff63a45de825c90dd9d30c4ff'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.225050 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5ee94ff63a45de825c90dd9d30c4ff'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.226390 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5ee94ff63a45de825c90dd9d30c4ff'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.235540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5ee94ff63a45de825c90dd9d30c4ff'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.236160 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5ee94ff63a45de825c90dd9d30c4ff'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.251774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1270/2544] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:08:17 2022] DELETE /identity/v3/users/ea5ee94ff63a45de825c90dd9d30c4ff => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:17.256632 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44788836-139a-4746-b977-ca90e3f958f7 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:17.257703 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44788836-139a-4746-b977-ca90e3f958f7 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:17.257821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44788836-139a-4746-b977-ca90e3f958f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:17.278272 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-44788836-139a-4746-b977-ca90e3f958f7 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:17.279472 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-44788836-139a-4746-b977-ca90e3f958f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:17.342745 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1275/2545] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:17.352605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:17.354032 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:17.413470 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f1e10-fe8a-4674-99b0-03318d5b195d admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:17.417251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc119b-04de-4377-9187-366438b86044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:17.417885 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc119b-04de-4377-9187-366438b86044 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:17.418162 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc119b-04de-4377-9187-366438b86044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:17.418431 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc119b-04de-4377-9187-366438b86044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:17.427378 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc119b-04de-4377-9187-366438b86044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:17.429640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc119b-04de-4377-9187-366438b86044 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:17.440767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1271/2546] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:08:17.713285 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44788836-139a-4746-b977-ca90e3f958f7 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:17.715099 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-44788836-139a-4746-b977-ca90e3f958f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:17.743961 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44788836-139a-4746-b977-ca90e3f958f7 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:17.748670 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:17.749282 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:17.749585 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:17.749857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] PATH_INFO: `/v3/projects/ddb002b2b7a44d61801ae74f63b47ba7` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:17.750963 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb002b2b7a44d61801ae74f63b47ba7)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:17.752895 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:17.803749 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb002b2b7a44d61801ae74f63b47ba7', 'request_id': 'req-a6b756ba-8421-4222-8226-9f7ea17135a7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.809231 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb002b2b7a44d61801ae74f63b47ba7', 'request_id': 'req-a6b756ba-8421-4222-8226-9f7ea17135a7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.815626 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb002b2b7a44d61801ae74f63b47ba7', 'request_id': 'req-a6b756ba-8421-4222-8226-9f7ea17135a7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.828534 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] The token cache is being invalidate because project ddb002b2b7a44d61801ae74f63b47ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:08:17.828824 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.829464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-a6b756ba-8421-4222-8226-9f7ea17135a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:17.830972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1276/2547] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:08:17 2022] DELETE /identity/v3/projects/ddb002b2b7a44d61801ae74f63b47ba7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:17.836411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77b7c6-fdc8-4428-8ef1-aaecf22e26a9 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:17.836694 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77b7c6-fdc8-4428-8ef1-aaecf22e26a9 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:17.836967 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77b7c6-fdc8-4428-8ef1-aaecf22e26a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:17.856342 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-4e77b7c6-fdc8-4428-8ef1-aaecf22e26a9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:17.857607 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4e77b7c6-fdc8-4428-8ef1-aaecf22e26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:17.918308 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1272/2548] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:17.926261 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b8bc-6c5a-400b-b6ef-19af096ca145 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:17.926535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b8bc-6c5a-400b-b6ef-19af096ca145 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:17.926809 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b8bc-6c5a-400b-b6ef-19af096ca145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:17.947980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-6fb7b8bc-6c5a-400b-b6ef-19af096ca145 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:17.949445 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6fb7b8bc-6c5a-400b-b6ef-19af096ca145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:17.958128 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1277/2549] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:17.962452 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77b7c6-fdc8-4428-8ef1-aaecf22e26a9 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:17.972022 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77b7c6-fdc8-4428-8ef1-aaecf22e26a9 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:17.976940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:17.977570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:17.977852 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:17.978122 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:17.979251 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:08:17.979405 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:17.981178 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:17.997476 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1273/2550] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:08:18.001839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b8bc-6c5a-400b-b6ef-19af096ca145 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:18.013174 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b8bc-6c5a-400b-b6ef-19af096ca145 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:18.017939 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339d2e5-3078-4d01-b559-1352768a6e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:18.018538 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d2e5-3078-4d01-b559-1352768a6e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:18.018810 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d2e5-3078-4d01-b559-1352768a6e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:18.019085 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d2e5-3078-4d01-b559-1352768a6e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:18.019871 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339d2e5-3078-4d01-b559-1352768a6e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:18.021791 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339d2e5-3078-4d01-b559-1352768a6e33 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:18.049712 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1278/2551] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:08:18 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:08:18.054465 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:18.059523 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:18.066129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b441f5-b1da-4e77-8c70-33d6039070de admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:18.133767 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6568f-d8c1-4cf6-84c3-7ad82ef010ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:18.134466 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6568f-d8c1-4cf6-84c3-7ad82ef010ab admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:18.134810 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6568f-d8c1-4cf6-84c3-7ad82ef010ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:18.135146 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6568f-d8c1-4cf6-84c3-7ad82ef010ab admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:18.135914 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6568f-d8c1-4cf6-84c3-7ad82ef010ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:18.137928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6568f-d8c1-4cf6-84c3-7ad82ef010ab admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:18.164167 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1274/2552] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:08:18 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:08:18.168238 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339d2e5-3078-4d01-b559-1352768a6e33 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:18.179360 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339d2e5-3078-4d01-b559-1352768a6e33 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:18.185761 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33645f-7095-4c7d-afe1-f44b0f6b651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:18.186381 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33645f-7095-4c7d-afe1-f44b0f6b651a admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:18.186656 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33645f-7095-4c7d-afe1-f44b0f6b651a admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:18.186926 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33645f-7095-4c7d-afe1-f44b0f6b651a admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:18.187574 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33645f-7095-4c7d-afe1-f44b0f6b651a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:18.189176 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33645f-7095-4c7d-afe1-f44b0f6b651a admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:18.200546 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1279/2553] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:08:18.204512 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6568f-d8c1-4cf6-84c3-7ad82ef010ab admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:18.216054 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6568f-d8c1-4cf6-84c3-7ad82ef010ab admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:18.220725 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ebfa4-f721-47fd-a2ad-23b897f58510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:18.221328 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebfa4-f721-47fd-a2ad-23b897f58510 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:18.221640 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebfa4-f721-47fd-a2ad-23b897f58510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:18.221919 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ebfa4-f721-47fd-a2ad-23b897f58510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:18.222625 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ebfa4-f721-47fd-a2ad-23b897f58510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:18.224217 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ebfa4-f721-47fd-a2ad-23b897f58510 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:18.356838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1275/2554] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:08:18.361467 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33645f-7095-4c7d-afe1-f44b0f6b651a admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:18.371647 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33645f-7095-4c7d-afe1-f44b0f6b651a admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:18.376526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:18.377170 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:18.377447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:18.377751 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] PATH_INFO: `/v3/projects/c729f19db9044ee19fe6d47b4270c930/users/d4fe09edcbe84d2d85859829a30b7856/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:18.392998 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c729f19db9044ee19fe6d47b4270c930, user_id=d4fe09edcbe84d2d85859829a30b7856, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:18.395690 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:18.409338 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1280/2555] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:08:18 2022] PUT /identity/v3/projects/c729f19db9044ee19fe6d47b4270c930/users/d4fe09edcbe84d2d85859829a30b7856/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:18.419963 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8144d4-f7b8-49fa-9481-c6cde740f7f1 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:18.420246 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8144d4-f7b8-49fa-9481-c6cde740f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:18.420513 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8144d4-f7b8-49fa-9481-c6cde740f7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:18.449382 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-9b8144d4-f7b8-49fa-9481-c6cde740f7f1 None None] MFA Rules not processed for user `d4fe09edcbe84d2d85859829a30b7856`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:18.450641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-9b8144d4-f7b8-49fa-9481-c6cde740f7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:18.515463 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1276/2556] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:18.527507 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:18.529200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:18.553071 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:18.611860 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df5648-918b-412d-87fd-60c80b5cb7bf admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:18.615455 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30217f7c-d59d-4a4e-abf1-5e7a20d86d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e3385f7c3948f9ab871233626c3257', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:18.616671 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217f7c-d59d-4a4e-abf1-5e7a20d86d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:18.616949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217f7c-d59d-4a4e-abf1-5e7a20d86d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:18.617219 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30217f7c-d59d-4a4e-abf1-5e7a20d86d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:18.625429 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30217f7c-d59d-4a4e-abf1-5e7a20d86d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:18.626886 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30217f7c-d59d-4a4e-abf1-5e7a20d86d1b service cinder] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:18.637150 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1281/2557] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:08:26.732241 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8144d4-f7b8-49fa-9481-c6cde740f7f1 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:26.792671 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8144d4-f7b8-49fa-9481-c6cde740f7f1 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:26.797350 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:26.798045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:26.798323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:26.798596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] PATH_INFO: `/v3/users/d4fe09edcbe84d2d85859829a30b7856` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:26.799751 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fe09edcbe84d2d85859829a30b7856)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:26.801682 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:26.813892 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:26.847426 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fe09edcbe84d2d85859829a30b7856'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:26.858931 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fe09edcbe84d2d85859829a30b7856'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:26.859589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fe09edcbe84d2d85859829a30b7856'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:26.867363 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fe09edcbe84d2d85859829a30b7856'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:26.868046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fe09edcbe84d2d85859829a30b7856'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:26.879922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1277/2558] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:08:26 2022] DELETE /identity/v3/users/d4fe09edcbe84d2d85859829a30b7856 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:26.885014 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005764bc-ee97-4331-97e0-de17425775df None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:26.885531 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005764bc-ee97-4331-97e0-de17425775df None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:26.885650 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005764bc-ee97-4331-97e0-de17425775df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:26.904004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-005764bc-ee97-4331-97e0-de17425775df None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:26.905195 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-005764bc-ee97-4331-97e0-de17425775df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:26.963511 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1282/2559] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:08:26.972997 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:26.974454 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:27.032503 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a639f-1bf1-467f-9cdf-ef14e25fb6ef admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:27.036069 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20131f8-deef-467e-a1cc-ae73395ed1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:27.036662 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20131f8-deef-467e-a1cc-ae73395ed1cb service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:27.036935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20131f8-deef-467e-a1cc-ae73395ed1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:27.037200 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20131f8-deef-467e-a1cc-ae73395ed1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:27.045898 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20131f8-deef-467e-a1cc-ae73395ed1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:27.047292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20131f8-deef-467e-a1cc-ae73395ed1cb service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:27.057012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1278/2560] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:08:27.323263 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005764bc-ee97-4331-97e0-de17425775df None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:27.324766 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-005764bc-ee97-4331-97e0-de17425775df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:27.336779 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005764bc-ee97-4331-97e0-de17425775df None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:27.341473 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:27.342121 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:27.342401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:27.342674 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] PATH_INFO: `/v3/projects/c729f19db9044ee19fe6d47b4270c930` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:27.343783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c729f19db9044ee19fe6d47b4270c930)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:27.345739 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:27.392846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c729f19db9044ee19fe6d47b4270c930', 'request_id': 'req-ea0abda5-bd57-4833-a6e5-433788f711b1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:27.398361 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c729f19db9044ee19fe6d47b4270c930', 'request_id': 'req-ea0abda5-bd57-4833-a6e5-433788f711b1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:27.404488 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c729f19db9044ee19fe6d47b4270c930', 'request_id': 'req-ea0abda5-bd57-4833-a6e5-433788f711b1'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:27.416757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] The token cache is being invalidate because project c729f19db9044ee19fe6d47b4270c930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:08:27.417079 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:27.417732 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:27.419200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1283/2561] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:08:27 2022] DELETE /identity/v3/projects/c729f19db9044ee19fe6d47b4270c930 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:37.052438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:37.413283 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:49.885268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d7991-9c6f-4197-be1e-f04fc29c4d8b None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:49.885875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d7991-9c6f-4197-be1e-f04fc29c4d8b None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:49.885875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d7991-9c6f-4197-be1e-f04fc29c4d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:49.904631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-8f7d7991-9c6f-4197-be1e-f04fc29c4d8b None None] MFA Rules not processed for user `b9daad0debe14575922551c03889ac02`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:49.906059 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8f7d7991-9c6f-4197-be1e-f04fc29c4d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:49.959545 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1279/2562] 10.222.0.47 () {58 vars in 967 bytes} [Fri Oct 14 13:08:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:49.982543 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:49.984004 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:50.051991 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0abda5-bd57-4833-a6e5-433788f711b1 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:50.056874 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62145c38-4feb-490b-8c35-adb10d31961b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d66e92ebdd94630b887b31470be78ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:50.057468 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62145c38-4feb-490b-8c35-adb10d31961b service swift] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:50.057775 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62145c38-4feb-490b-8c35-adb10d31961b service swift] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:50.058043 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62145c38-4feb-490b-8c35-adb10d31961b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:50.065890 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62145c38-4feb-490b-8c35-adb10d31961b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:50.067402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62145c38-4feb-490b-8c35-adb10d31961b service swift] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:50.075187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1284/2563] 10.222.0.47 () {60 vars in 1384 bytes} [Fri Oct 14 13:08:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:08:57.171525 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d7991-9c6f-4197-be1e-f04fc29c4d8b None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:57.172989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-8f7d7991-9c6f-4197-be1e-f04fc29c4d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:57.245223 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d7991-9c6f-4197-be1e-f04fc29c4d8b None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:57.250336 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:57.250962 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:57.251331 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:57.251801 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] PATH_INFO: `/v3/users/75c10f4846c2498e8cc93a3c3c5ecdd9` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:57.252947 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c10f4846c2498e8cc93a3c3c5ecdd9)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:57.254924 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:57.302203 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c10f4846c2498e8cc93a3c3c5ecdd9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.315383 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c10f4846c2498e8cc93a3c3c5ecdd9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.316116 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c10f4846c2498e8cc93a3c3c5ecdd9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.324356 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c10f4846c2498e8cc93a3c3c5ecdd9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.324966 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c10f4846c2498e8cc93a3c3c5ecdd9'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.338004 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1280/2564] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:08:57 2022] DELETE /identity/v3/users/75c10f4846c2498e8cc93a3c3c5ecdd9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:57.510213 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62145c38-4feb-490b-8c35-adb10d31961b service swift] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:57.521163 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62145c38-4feb-490b-8c35-adb10d31961b service swift] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:57.579274 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:57.579838 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:57.580136 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:57.580389 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] PATH_INFO: `/v3/projects/d79493455fcd4feabbbecbe929e0f5fc` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:57.581555 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79493455fcd4feabbbecbe929e0f5fc)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:57.583497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:57.630151 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79493455fcd4feabbbecbe929e0f5fc', 'request_id': 'req-8e63db9d-2f53-449d-b4f3-9d425d714ea7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.635733 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79493455fcd4feabbbecbe929e0f5fc', 'request_id': 'req-8e63db9d-2f53-449d-b4f3-9d425d714ea7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.641989 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79493455fcd4feabbbecbe929e0f5fc', 'request_id': 'req-8e63db9d-2f53-449d-b4f3-9d425d714ea7'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.654463 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] The token cache is being invalidate because project d79493455fcd4feabbbecbe929e0f5fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:08:57.654744 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.655363 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.656826 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1285/2565] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:08:57 2022] DELETE /identity/v3/projects/d79493455fcd4feabbbecbe929e0f5fc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:57.660867 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:57.662385 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:57.675932 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322443b-77b3-43e0-9271-96fbd6db7f81 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:57.695589 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:57.738017 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:57.738645 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:57.738928 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:57.739194 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] PATH_INFO: `/v3/users/77390850abe64c2782654fcd01434ff7` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:57.740326 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77390850abe64c2782654fcd01434ff7)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:57.742252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:57.786438 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77390850abe64c2782654fcd01434ff7'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.798534 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77390850abe64c2782654fcd01434ff7'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.799183 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77390850abe64c2782654fcd01434ff7'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.805951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77390850abe64c2782654fcd01434ff7'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.806563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-b4fcb665-91d2-4780-b01b-3eb3625db982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77390850abe64c2782654fcd01434ff7'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:57.818458 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1281/2566] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:08:57 2022] DELETE /identity/v3/users/77390850abe64c2782654fcd01434ff7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:57.991183 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:57.992604 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:58.006435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63db9d-2f53-449d-b4f3-9d425d714ea7 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:58.031664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:58.081012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:58.081012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.081012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.081012 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] PATH_INFO: `/v3/projects/c15ad422b1f447dba44418576bd18d6f` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.081403 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15ad422b1f447dba44418576bd18d6f)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:58.081554 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:58.130192 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15ad422b1f447dba44418576bd18d6f', 'request_id': 'req-5790cc3e-2bf6-440f-9741-7e8742e0e98c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:58.136106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15ad422b1f447dba44418576bd18d6f', 'request_id': 'req-5790cc3e-2bf6-440f-9741-7e8742e0e98c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:58.142747 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15ad422b1f447dba44418576bd18d6f', 'request_id': 'req-5790cc3e-2bf6-440f-9741-7e8742e0e98c'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:58.157674 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] The token cache is being invalidate because project c15ad422b1f447dba44418576bd18d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:08:58.157972 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:58.158598 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-5790cc3e-2bf6-440f-9741-7e8742e0e98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:08:58.160334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1286/2567] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:08:57 2022] DELETE /identity/v3/projects/c15ad422b1f447dba44418576bd18d6f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:58.164948 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f88cd-a8c0-44f3-ae42-f2c477c20da6 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.165358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f88cd-a8c0-44f3-ae42-f2c477c20da6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.165871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f88cd-a8c0-44f3-ae42-f2c477c20da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.187383 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-097f88cd-a8c0-44f3-ae42-f2c477c20da6 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:58.190131 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-097f88cd-a8c0-44f3-ae42-f2c477c20da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:58.272286 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1282/2568] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:58.280193 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fa5a-a94e-410c-a36e-1c2c7d756cc2 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.280578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fa5a-a94e-410c-a36e-1c2c7d756cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.280952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fa5a-a94e-410c-a36e-1c2c7d756cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.301723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-c338fa5a-a94e-410c-a36e-1c2c7d756cc2 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:58.303091 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c338fa5a-a94e-410c-a36e-1c2c7d756cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:58.311908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1287/2569] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:58.316275 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f88cd-a8c0-44f3-ae42-f2c477c20da6 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:58.326871 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f88cd-a8c0-44f3-ae42-f2c477c20da6 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:58.331670 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:58.332264 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.332538 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.332836 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.333495 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:08:58.333856 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:58.335564 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:58.349501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1283/2570] 10.222.0.47 () {58 vars in 1153 bytes} [Fri Oct 14 13:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:08:58.354006 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338fa5a-a94e-410c-a36e-1c2c7d756cc2 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:58.364659 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338fa5a-a94e-410c-a36e-1c2c7d756cc2 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:58.370736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf068fd-9303-4900-aadc-08d14cc7992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:58.371278 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf068fd-9303-4900-aadc-08d14cc7992d admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.371535 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf068fd-9303-4900-aadc-08d14cc7992d admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.371803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf068fd-9303-4900-aadc-08d14cc7992d admin admin] PATH_INFO: `/v3/projects` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.372435 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf068fd-9303-4900-aadc-08d14cc7992d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:58.374366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf068fd-9303-4900-aadc-08d14cc7992d admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:58.402306 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1288/2571] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:08:58 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:08:58.406505 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:58.416325 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48490-7969-40dc-8f5b-9f092ed91ad2 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:58.444544 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:58.474609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee61f4-ba93-4d18-a9a3-e43f949a6cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:58.475208 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee61f4-ba93-4d18-a9a3-e43f949a6cac admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.475482 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee61f4-ba93-4d18-a9a3-e43f949a6cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.475745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee61f4-ba93-4d18-a9a3-e43f949a6cac admin admin] PATH_INFO: `/v3/users` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.476371 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee61f4-ba93-4d18-a9a3-e43f949a6cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:58.478384 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee61f4-ba93-4d18-a9a3-e43f949a6cac admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:58.499560 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1284/2572] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:08:58 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:08:58.503821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf068fd-9303-4900-aadc-08d14cc7992d admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:58.514528 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf068fd-9303-4900-aadc-08d14cc7992d admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:58.519058 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8fccd-74de-4afa-9f10-6efa141dd154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:58.519646 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8fccd-74de-4afa-9f10-6efa141dd154 admin admin] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.519918 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8fccd-74de-4afa-9f10-6efa141dd154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.520184 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8fccd-74de-4afa-9f10-6efa141dd154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.520815 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8fccd-74de-4afa-9f10-6efa141dd154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:58.522427 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8fccd-74de-4afa-9f10-6efa141dd154 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:58.532016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1289/2573] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:08:58.535746 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee61f4-ba93-4d18-a9a3-e43f949a6cac admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:58.545414 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee61f4-ba93-4d18-a9a3-e43f949a6cac admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:58.549954 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66b2fc-9010-4a02-b2fd-6d8ff136aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:58.550531 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66b2fc-9010-4a02-b2fd-6d8ff136aab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.550800 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66b2fc-9010-4a02-b2fd-6d8ff136aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.551068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66b2fc-9010-4a02-b2fd-6d8ff136aab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.551693 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66b2fc-9010-4a02-b2fd-6d8ff136aab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:58.553236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66b2fc-9010-4a02-b2fd-6d8ff136aab5 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:58.563605 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1285/2574] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:08:58.567636 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8fccd-74de-4afa-9f10-6efa141dd154 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:58.578011 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8fccd-74de-4afa-9f10-6efa141dd154 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:58.582564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:58.583200 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.583475 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.583746 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] PATH_INFO: `/v3/projects/d5a0e78a09a843b1b6d2eee3ed8f7903/users/159c0ca7e417485b8ae497301a669228/roles/a754d895803642e894fc6ccc699d51d9` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.597786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a0e78a09a843b1b6d2eee3ed8f7903, user_id=159c0ca7e417485b8ae497301a669228, role_id=a754d895803642e894fc6ccc699d51d9)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:58.600438 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:58.613402 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1290/2575] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:08:58 2022] PUT /identity/v3/projects/d5a0e78a09a843b1b6d2eee3ed8f7903/users/159c0ca7e417485b8ae497301a669228/roles/a754d895803642e894fc6ccc699d51d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:08:58.618499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ef29a-9244-4e23-b2e0-ef6950a6d3c9 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.619323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ef29a-9244-4e23-b2e0-ef6950a6d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.619593 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ef29a-9244-4e23-b2e0-ef6950a6d3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.638567 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d48ef29a-9244-4e23-b2e0-ef6950a6d3c9 None None] MFA Rules not processed for user `ced917b9e08744f88e2078e19eb8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:58.639684 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d48ef29a-9244-4e23-b2e0-ef6950a6d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:58.698207 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1286/2576] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:58.707797 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:58.709458 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:58.762786 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:58.768785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ee3c4-c63c-4a00-b4fc-e91c66d71edc admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:58.773156 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e876cc8-d630-482b-8bd6-c2dc0d237d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:58.773949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e876cc8-d630-482b-8bd6-c2dc0d237d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:58.774225 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e876cc8-d630-482b-8bd6-c2dc0d237d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:58.774497 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e876cc8-d630-482b-8bd6-c2dc0d237d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:58.783415 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e876cc8-d630-482b-8bd6-c2dc0d237d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:58.784846 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e876cc8-d630-482b-8bd6-c2dc0d237d5d service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:58.794787 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1291/2577] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:02.573853 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bf8f-3e56-44c8-9bf2-d3113c638f38 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:02.574341 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bf8f-3e56-44c8-9bf2-d3113c638f38 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:02.574442 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bf8f-3e56-44c8-9bf2-d3113c638f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:02.606228 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-3381bf8f-3e56-44c8-9bf2-d3113c638f38 None None] MFA Rules not processed for user `72c8077c28fa40a99c090dc6b11a769b`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:02.607527 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3381bf8f-3e56-44c8-9bf2-d3113c638f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:02.689536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1287/2578] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:09:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:03.170005 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88e81-e88e-481e-a1e0-7620cdbbcb98 None None] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:03.170578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88e81-e88e-481e-a1e0-7620cdbbcb98 None None] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:03.170578 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88e81-e88e-481e-a1e0-7620cdbbcb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:03.207358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.auth.core [None req-18e88e81-e88e-481e-a1e0-7620cdbbcb98 None None] MFA Rules not processed for user `159c0ca7e417485b8ae497301a669228`. Rule list: `[]` (Enabled: `True`). {{(pid=81395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:03.208618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-18e88e81-e88e-481e-a1e0-7620cdbbcb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:03.287708 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1292/2579] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:09:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:03.292716 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381bf8f-3e56-44c8-9bf2-d3113c638f38 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:03.305176 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381bf8f-3e56-44c8-9bf2-d3113c638f38 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:03.310696 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbfbd5-9bc0-414b-afd4-f4c22f988547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:03.311354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbfbd5-9bc0-414b-afd4-f4c22f988547 admin admin] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:03.311596 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbfbd5-9bc0-414b-afd4-f4c22f988547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:03.314258 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbfbd5-9bc0-414b-afd4-f4c22f988547 admin admin] PATH_INFO: `/v3/projects` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:03.314940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbfbd5-9bc0-414b-afd4-f4c22f988547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:03.317236 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbfbd5-9bc0-414b-afd4-f4c22f988547 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:03.350465 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e88e81-e88e-481e-a1e0-7620cdbbcb98 None None] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:03.352038 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1288/2580] 10.222.0.47 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:03 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:03.362806 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e88e81-e88e-481e-a1e0-7620cdbbcb98 None None] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:03.432927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72deab-545a-48c2-b343-d07537712bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:03.433704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72deab-545a-48c2-b343-d07537712bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:03.433993 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72deab-545a-48c2-b343-d07537712bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:03.434262 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72deab-545a-48c2-b343-d07537712bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:03.435057 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72deab-545a-48c2-b343-d07537712bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:03.437771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72deab-545a-48c2-b343-d07537712bd0 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:03.464523 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1293/2581] 10.222.0.47 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:03 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:09:03.465971 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbfbd5-9bc0-414b-afd4-f4c22f988547 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:03.483501 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbfbd5-9bc0-414b-afd4-f4c22f988547 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:03.491630 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56785c0-dd3b-4abc-bb77-e9bfefa69d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:03.492411 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56785c0-dd3b-4abc-bb77-e9bfefa69d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:03.492838 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56785c0-dd3b-4abc-bb77-e9bfefa69d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:03.493211 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56785c0-dd3b-4abc-bb77-e9bfefa69d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:03.494600 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56785c0-dd3b-4abc-bb77-e9bfefa69d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:03.497856 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56785c0-dd3b-4abc-bb77-e9bfefa69d07 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:03.514930 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1289/2582] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:03.519102 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72deab-545a-48c2-b343-d07537712bd0 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:03.534155 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72deab-545a-48c2-b343-d07537712bd0 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:03.539279 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d946-0767-4d8a-9c30-f59dd89471de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:03.540119 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d946-0767-4d8a-9c30-f59dd89471de admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:03.541513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d946-0767-4d8a-9c30-f59dd89471de admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:03.541513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d946-0767-4d8a-9c30-f59dd89471de admin admin] PATH_INFO: `/v3/projects/7464ac4c7c1f46ad86a9de38bd55842f/users/0973bf992f6d40309607f792dd0c5eb3/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:03.562319 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8d946-0767-4d8a-9c30-f59dd89471de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7464ac4c7c1f46ad86a9de38bd55842f, user_id=0973bf992f6d40309607f792dd0c5eb3, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:03.566277 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8d946-0767-4d8a-9c30-f59dd89471de admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:03.581512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1294/2583] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:03 2022] PUT /identity/v3/projects/7464ac4c7c1f46ad86a9de38bd55842f/users/0973bf992f6d40309607f792dd0c5eb3/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:03.585676 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56785c0-dd3b-4abc-bb77-e9bfefa69d07 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:03.597008 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56785c0-dd3b-4abc-bb77-e9bfefa69d07 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:03.617950 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:03.663368 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec28b-9f40-427f-8ec2-654e3da2bc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:03.664021 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec28b-9f40-427f-8ec2-654e3da2bc5e admin admin] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:03.664292 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec28b-9f40-427f-8ec2-654e3da2bc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:03.664580 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec28b-9f40-427f-8ec2-654e3da2bc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:03.665252 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ec28b-9f40-427f-8ec2-654e3da2bc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:03.667644 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ec28b-9f40-427f-8ec2-654e3da2bc5e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:03.679492 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1290/2584] 10.222.0.47 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:03.684398 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d946-0767-4d8a-9c30-f59dd89471de admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:03.695330 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d946-0767-4d8a-9c30-f59dd89471de admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:03.700631 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:03.701300 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:03.701642 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:03.701964 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] PATH_INFO: `/v3/projects/7464ac4c7c1f46ad86a9de38bd55842f/users/0973bf992f6d40309607f792dd0c5eb3/roles/4c6ad52a91ee49469aa1934cdc11b55c` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:03.704059 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7464ac4c7c1f46ad86a9de38bd55842f, user_id=0973bf992f6d40309607f792dd0c5eb3, role_id=4c6ad52a91ee49469aa1934cdc11b55c)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:03.706784 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:03.719345 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1295/2585] 10.222.0.47 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:03 2022] PUT /identity/v3/projects/7464ac4c7c1f46ad86a9de38bd55842f/users/0973bf992f6d40309607f792dd0c5eb3/roles/4c6ad52a91ee49469aa1934cdc11b55c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:09.061719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be19f0d-f17a-4c64-9b8f-bf338737e78f None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:09.062210 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be19f0d-f17a-4c64-9b8f-bf338737e78f None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:09.062321 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be19f0d-f17a-4c64-9b8f-bf338737e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:09.092783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-2be19f0d-f17a-4c64-9b8f-bf338737e78f None None] MFA Rules not processed for user `0973bf992f6d40309607f792dd0c5eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:09.094129 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-2be19f0d-f17a-4c64-9b8f-bf338737e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:09.167114 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1291/2586] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:09:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:09.181096 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:09.186280 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:09.224302 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:09.293553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430028a-a27f-43b7-af4d-cc05d6c3ca9c admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:09.300198 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6e46-3cc3-4001-95c4-7c771b4c8a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:09.300785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6e46-3cc3-4001-95c4-7c771b4c8a98 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:09.301103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6e46-3cc3-4001-95c4-7c771b4c8a98 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:09.301383 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6e46-3cc3-4001-95c4-7c771b4c8a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:09.356907 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c6e46-3cc3-4001-95c4-7c771b4c8a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:09.358533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c6e46-3cc3-4001-95c4-7c771b4c8a98 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:09.367740 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1296/2587] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:19.163875 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=53 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:19.363609 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=51 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:29.941642 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d9cc-970d-4e43-8bdf-c03d5cd782b7 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:29.942215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d9cc-970d-4e43-8bdf-c03d5cd782b7 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:29.942215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d9cc-970d-4e43-8bdf-c03d5cd782b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:29.961127 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d4c4d9cc-970d-4e43-8bdf-c03d5cd782b7 None None] MFA Rules not processed for user `159c0ca7e417485b8ae497301a669228`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:29.962354 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d4c4d9cc-970d-4e43-8bdf-c03d5cd782b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:29.969773 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1292/2588] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:09:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:33.068803 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6e46-3cc3-4001-95c4-7c771b4c8a98 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:33.125305 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6e46-3cc3-4001-95c4-7c771b4c8a98 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:33.128952 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:33.129586 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:33.129889 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:33.130157 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:33.131927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:33.145829 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:33.147397 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:33.159625 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1297/2589] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:36.886389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4d9cc-970d-4e43-8bdf-c03d5cd782b7 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.887902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d4c4d9cc-970d-4e43-8bdf-c03d5cd782b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:36.899811 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4d9cc-970d-4e43-8bdf-c03d5cd782b7 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.904012 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.904606 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.904881 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.905150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.906814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:36.919641 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.921049 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.931944 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1293/2590] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:43.154352 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=26 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:46.927031 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=9 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:50.157864 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.167066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9ab4-79c0-481d-902f-decc64a99e30 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.170737 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1791ad-3874-46eb-96a2-92c4f4e785bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.171413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1791ad-3874-46eb-96a2-92c4f4e785bb service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.171698 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1791ad-3874-46eb-96a2-92c4f4e785bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.171962 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1791ad-3874-46eb-96a2-92c4f4e785bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.181526 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1791ad-3874-46eb-96a2-92c4f4e785bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.182956 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1791ad-3874-46eb-96a2-92c4f4e785bb service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:50.192588 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1298/2591] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:59.700023 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:59.701563 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:59.765345 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9657a89-8cda-4259-ba97-254ca32a0fa4 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:59.770481 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:59.771112 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:59.771387 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:59.771651 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] PATH_INFO: `/v3/users/72c8077c28fa40a99c090dc6b11a769b` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:59.772806 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c8077c28fa40a99c090dc6b11a769b)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:59.775319 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:59.819849 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c8077c28fa40a99c090dc6b11a769b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:59.831668 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c8077c28fa40a99c090dc6b11a769b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:59.832333 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c8077c28fa40a99c090dc6b11a769b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:59.840060 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c8077c28fa40a99c090dc6b11a769b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:59.840807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c8077c28fa40a99c090dc6b11a769b'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:59.853299 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1294/2592] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:59 2022] DELETE /identity/v3/users/72c8077c28fa40a99c090dc6b11a769b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:00.021066 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1791ad-3874-46eb-96a2-92c4f4e785bb service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:00.032618 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1791ad-3874-46eb-96a2-92c4f4e785bb service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:00.089967 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:00.090607 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:00.090887 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:00.091159 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] PATH_INFO: `/v3/projects/bec5bb9b1b73416fb97534f476f2dce2` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:00.092281 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec5bb9b1b73416fb97534f476f2dce2)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:00.094224 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:00.139235 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec5bb9b1b73416fb97534f476f2dce2', 'request_id': 'req-96c0a189-96f8-4545-8c91-84e3f99e5d70'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.144752 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec5bb9b1b73416fb97534f476f2dce2', 'request_id': 'req-96c0a189-96f8-4545-8c91-84e3f99e5d70'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.151514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec5bb9b1b73416fb97534f476f2dce2', 'request_id': 'req-96c0a189-96f8-4545-8c91-84e3f99e5d70'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.163513 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] The token cache is being invalidate because project bec5bb9b1b73416fb97534f476f2dce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:00.163827 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.164486 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.166372 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1299/2593] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:00 2022] DELETE /identity/v3/projects/bec5bb9b1b73416fb97534f476f2dce2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:09.849389 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:10.160508 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:52.241837 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:52.243234 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:52.300433 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf76937-4338-4613-8063-4910fcce6b15 admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:52.346902 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bd861-3462-4451-a8a0-a0423fea086c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:52.347499 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd861-3462-4451-a8a0-a0423fea086c service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:52.347776 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd861-3462-4451-a8a0-a0423fea086c service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:52.348046 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd861-3462-4451-a8a0-a0423fea086c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:52.349783 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c11bd861-3462-4451-a8a0-a0423fea086c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:52.359528 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bd861-3462-4451-a8a0-a0423fea086c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:52.361266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bd861-3462-4451-a8a0-a0423fea086c service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:52.369159 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1295/2594] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:02.365467 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=46 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:49.941776 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:49.944017 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:50.033755 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0a189-96f8-4545-8c91-84e3f99e5d70 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:50.040097 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:50.040736 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:50.041018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:50.041293 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:50.043215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:50.058016 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:50.059699 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:50.072553 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1300/2595] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:51.182468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89c4d-b214-4b2e-a866-009e5b957a31 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:51.182935 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89c4d-b214-4b2e-a866-009e5b957a31 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:51.183035 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89c4d-b214-4b2e-a866-009e5b957a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:51.201870 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-d4f89c4d-b214-4b2e-a866-009e5b957a31 None None] MFA Rules not processed for user `159c0ca7e417485b8ae497301a669228`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:51.203045 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d4f89c4d-b214-4b2e-a866-009e5b957a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:51.257154 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1296/2596] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:51.565023 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:51.566457 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:51.577499 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8b4cc-b556-440e-b2fd-f3272c6eff15 service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:51.580971 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:51.581653 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:51.581927 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:51.582194 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:51.584394 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:51.593401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:51.594840 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:51.603255 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1301/2597] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:52.046357 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89c4d-b214-4b2e-a866-009e5b957a31 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:52.047799 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-d4f89c4d-b214-4b2e-a866-009e5b957a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:52.122557 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89c4d-b214-4b2e-a866-009e5b957a31 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:52.127570 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb4a36-da12-4ae5-a760-8987bf817d85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:52.128172 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4a36-da12-4ae5-a760-8987bf817d85 service placement] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:52.128448 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4a36-da12-4ae5-a760-8987bf817d85 service placement] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:52.128719 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb4a36-da12-4ae5-a760-8987bf817d85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:52.130987 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-cbeb4a36-da12-4ae5-a760-8987bf817d85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:52.142358 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb4a36-da12-4ae5-a760-8987bf817d85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:52.143917 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb4a36-da12-4ae5-a760-8987bf817d85 service placement] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:52.161425 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1297/2598] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:12:01.599633 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=40 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:12:02.150075 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=57 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:12:03.988969 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:12:04.004108 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20130b5-432c-457e-948d-35c476c6ba07 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:12:04.010704 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:12:04.011309 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:12:04.011614 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:12:04.011857 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:12:04.013594 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:12:04.026413 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:12:04.028038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:12:04.039083 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1302/2599] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:12:14.034201 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:41.042602 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6ed4-3fbb-4252-b7f1-e3b85e5b18c6 None None] REQUEST_METHOD: `POST` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:41.043150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6ed4-3fbb-4252-b7f1-e3b85e5b18c6 None None] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:41.043150 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6ed4-3fbb-4252-b7f1-e3b85e5b18c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:41.062908 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.auth.core [None req-c78c6ed4-3fbb-4252-b7f1-e3b85e5b18c6 None None] MFA Rules not processed for user `159c0ca7e417485b8ae497301a669228`. Rule list: `[]` (Enabled: `True`). {{(pid=81394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:41.064096 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c78c6ed4-3fbb-4252-b7f1-e3b85e5b18c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:41.070833 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1298/2600] 10.222.0.47 () {58 vars in 958 bytes} [Fri Oct 14 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:42.257597 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:42.258980 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:42.273207 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b2f48-3ad3-4b32-aaa0-dbc00c3dc4cf service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:42.278333 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:42.278943 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:42.279222 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:42.279492 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:42.281267 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:42.292757 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:42.294369 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:42.304949 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1303/2601] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:51.057447 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=3 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:52.300592 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=6 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:35.574609 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6ed4-3fbb-4252-b7f1-e3b85e5b18c6 None None] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:35.575998 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-c78c6ed4-3fbb-4252-b7f1-e3b85e5b18c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:35.588268 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6ed4-3fbb-4252-b7f1-e3b85e5b18c6 None None] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:35.591779 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:35.592362 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:35.592631 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:35.592893 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:35.594576 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:35.606068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:35.607529 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:35.616324 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1299/2602] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:15:36.655634 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:36.665953 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb776d-73bb-4ee8-8a58-e979582c48f7 service placement] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:36.669908 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:36.670514 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:36.670793 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:36.671065 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:36.672785 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:36.687334 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:36.688781 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:36.700564 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1304/2603] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:37.882315 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:37.890722 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638336d-ef07-4ad4-9622-159288bd65c0 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:37.894377 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:37.894961 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:37.895233 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:37.895500 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:37.897829 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:37.910762 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:37.912193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:37.922960 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1300/2604] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:38.540215 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:38.551601 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cac3f-7c98-4b7a-bf29-5b7015606dd8 service neutron] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:38.558480 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd360b800645041cf8caa43dcc0116761', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:38.559171 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:38.559454 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:38.559723 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:38.561533 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:38.575536 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:38.577153 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:38.588401 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1305/2605] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:47.918266 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=12 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:48.583172 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=12 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:49.049774 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:49.058437 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56fbde-acfe-4739-8164-4cf157011b6b service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:49.061951 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '899319384b8b471f8d308f37be459c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:49.062540 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:49.062814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:49.063081 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:49.064907 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:49.127686 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:49.129099 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:49.139108 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1301/2606] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:52.188358 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:52.231519 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111c734-9aeb-4022-ad7e-f328203c75be service nova] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:52.237256 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:52.237933 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:52.238187 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:52.238464 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:52.240343 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:52.253035 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:52.255111 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:52.268836 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1306/2607] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:55.343323 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:55.355068 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bef93-cd28-4c1c-93b6-44178684ffd5 service neutron] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:55.362468 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:55.363193 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] REQUEST_METHOD: `GET` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:55.363475 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:55.363745 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:55.365568 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:55.377827 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:55.380077 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:55.390604 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1302/2608] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:55.410808 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:55.412839 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:55.431038 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a22eb2-d53b-4e19-a427-deee0c50ffc4 service placement] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:55.436106 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:55.436738 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:55.437018 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:55.437292 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] PATH_INFO: `/v3/users/159c0ca7e417485b8ae497301a669228` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:55.438474 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=159c0ca7e417485b8ae497301a669228)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:55.440447 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:55.486521 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159c0ca7e417485b8ae497301a669228'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.498664 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159c0ca7e417485b8ae497301a669228'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.499329 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159c0ca7e417485b8ae497301a669228'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.507310 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159c0ca7e417485b8ae497301a669228'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.508135 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159c0ca7e417485b8ae497301a669228'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.520485 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1307/2609] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:15:55 2022] DELETE /identity/v3/users/159c0ca7e417485b8ae497301a669228 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:55.691711 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:55.704814 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a3b4-231e-459d-acd9-e610869d1a0c service placement] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:55.763665 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:55.764305 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:55.764582 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:55.764847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] PATH_INFO: `/v3/projects/d5a0e78a09a843b1b6d2eee3ed8f7903` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:55.765989 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a0e78a09a843b1b6d2eee3ed8f7903)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:55.767847 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:55.813940 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'request_id': 'req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.819918 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'request_id': 'req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.826139 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'request_id': 'req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.839106 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] The token cache is being invalidate because project d5a0e78a09a843b1b6d2eee3ed8f7903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:15:55.839398 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.840016 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.841536 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1303/2610] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:15:55 2022] DELETE /identity/v3/projects/d5a0e78a09a843b1b6d2eee3ed8f7903 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:15:55.845641 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:55.847030 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:55.859869 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa666e-926b-472c-befe-7025542df0ae admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:55.915898 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:55.916504 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:55.916777 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:55.917044 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] PATH_INFO: `/v3/users/0973bf992f6d40309607f792dd0c5eb3` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:55.918182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0973bf992f6d40309607f792dd0c5eb3)` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:55.920103 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:55.969669 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0973bf992f6d40309607f792dd0c5eb3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.980813 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:55.982700 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0973bf992f6d40309607f792dd0c5eb3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.983661 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0973bf992f6d40309607f792dd0c5eb3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.992821 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0973bf992f6d40309607f792dd0c5eb3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:55.993702 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.notifications [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0973bf992f6d40309607f792dd0c5eb3'} {{(pid=81395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:56.006771 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1308/2611] 10.222.0.47 () {58 vars in 1224 bytes} [Fri Oct 14 13:15:55 2022] DELETE /identity/v3/users/0973bf992f6d40309607f792dd0c5eb3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:56.172225 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] Authenticating user token {{(pid=81394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:56.173687 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.fernet_utils [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:56.187543 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4381fda-8e61-44fd-ac82-48ce71ad2d3e admin admin] Validating token access rules against request {{(pid=81394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:56.196215 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:56.246807 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ced917b9e08744f88e2078e19eb8640b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48f83413dd8d497d98e9b13f0fa4b793', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:56.247344 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:56.247650 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:56.247922 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] PATH_INFO: `/v3/projects/7464ac4c7c1f46ad86a9de38bd55842f` {{(pid=81394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:56.249051 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7464ac4c7c1f46ad86a9de38bd55842f)` {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:56.250992 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] RBAC: Authorization granted {{(pid=81394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:56.297164 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7464ac4c7c1f46ad86a9de38bd55842f', 'request_id': 'req-532a4784-2d09-4ae0-bbf0-2aeddfd97455'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:56.302612 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7464ac4c7c1f46ad86a9de38bd55842f', 'request_id': 'req-532a4784-2d09-4ae0-bbf0-2aeddfd97455'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:56.308646 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7464ac4c7c1f46ad86a9de38bd55842f', 'request_id': 'req-532a4784-2d09-4ae0-bbf0-2aeddfd97455'} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:56.322271 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] The token cache is being invalidate because project 7464ac4c7c1f46ad86a9de38bd55842f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:15:56.322562 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:56.323177 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG keystone.notifications [None req-532a4784-2d09-4ae0-bbf0-2aeddfd97455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:56.324627 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: [pid: 81394|app: 0|req: 1304/2612] 10.222.0.47 () {58 vars in 1233 bytes} [Fri Oct 14 13:15:56 2022] DELETE /identity/v3/projects/7464ac4c7c1f46ad86a9de38bd55842f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:16:06.002783 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:16:06.319332 dv-cinder-820994-7-iscsi devstack@keystone.service[81394]: DEBUG dbcounter [-] [81394] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:19:04.485182 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] Authenticating user token {{(pid=81395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:19:04.486804 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:19:04.622500 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803eb28-dd57-4102-99a1-44bb1523bc38 admin admin] Validating token access rules against request {{(pid=81395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:19:04.679762 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8f062-5425-40c4-b078-ad12ae0ae2a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4a7dff4f94f4b28ab8e5ae9b7d9aebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a39ed153440b4dd9afb3945cfd55fed3', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:19:04.680366 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f062-5425-40c4-b078-ad12ae0ae2a0 service placement] REQUEST_METHOD: `GET` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:19:04.680651 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f062-5425-40c4-b078-ad12ae0ae2a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:19:04.680951 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8f062-5425-40c4-b078-ad12ae0ae2a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:19:04.682788 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.fernet_utils [None req-44c8f062-5425-40c4-b078-ad12ae0ae2a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:19:04.693878 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f062-5425-40c4-b078-ad12ae0ae2a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:19:04.695512 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8f062-5425-40c4-b078-ad12ae0ae2a0 service placement] RBAC: Authorization granted {{(pid=81395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:19:04.705845 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: [pid: 81395|app: 0|req: 1309/2613] 10.222.0.47 () {60 vars in 1365 bytes} [Fri Oct 14 13:19:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:19:14.701591 dv-cinder-820994-7-iscsi devstack@keystone.service[81395]: DEBUG dbcounter [-] [81395] Writing DB stats keystone:SELECT=89 {{(pid=81395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}